Jul 07 22:26:16 devstack cinder-volume[76914]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:26:16 devstack cinder-volume[76914]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:26:16 devstack cinder-volume[76914]: we strongly recommend against using it for new projects.
Jul 07 22:26:16 devstack cinder-volume[76914]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:26:16 devstack cinder-volume[76914]: framework.  For more detail see
Jul 07 22:26:16 devstack cinder-volume[76914]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:26:16 devstack cinder-volume[76914]:   import eventlet  # noqa
Jul 07 22:26:19 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:26:19 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:26:19 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:26:20 devstack cinder-volume[76914]: INFO dbcounter [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Registered counter for database cinder
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG oslo_db.sqlalchemy.engines [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76914) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG dbcounter [-] [76914] Writer thread running {{(pid=76914) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:26:20 devstack cinder-volume[76914]: INFO cinder.rpc [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:26:20 devstack cinder-volume[76914]: INFO cinder.rpc [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG oslo_db.sqlalchemy.engines [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76914) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:26:20 devstack cinder-volume[76914]: INFO cinder.volume.manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Determined volume DB was empty at startup.
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG cinder.volume.manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76914) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:26:20 devstack cinder-volume[76914]: INFO cinder.volume.manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 22:26:20 devstack cinder-volume[76914]: WARNING stevedore.named [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:26:20 devstack cinder-volume[76914]: WARNING castellan.key_manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:26:20 devstack cinder-volume[76914]: WARNING cinder.keymgr.conf_key_mgr [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG cinder.volume.drivers.lvm [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76914) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 07 22:26:20 devstack cinder-volume[76914]: DEBUG oslo_concurrency.processutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76914) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_concurrency.processutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] CMD "cinder-rtstool verify" returned: 0 in 0.524s {{(pid=76914) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_db.sqlalchemy.engines [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76914) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:26:21 devstack cinder-volume[76914]: INFO cinder.rpc [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 07 22:26:21 devstack cinder-volume[76914]: INFO cinder.rpc [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 07 22:26:21 devstack cinder-volume[76914]: WARNING stevedore.named [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:26:21 devstack cinder-volume[76914]: WARNING castellan.key_manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:26:21 devstack cinder-volume[76914]: INFO cinder.volume.manager [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_db.sqlalchemy.engines [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76914) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:26:21 devstack cinder-volume[76914]: INFO oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Starting 1 workers
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Started child 77081 {{(pid=76914) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Full set of CONF: {{(pid=76914) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] ******************************************************************************** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Configuration options gathered from: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] ================================================================================ {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] allow_availability_zone_fallback = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] allow_compression_on_image_upload = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] allowed_direct_url_schemes     = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] api_rate_limit                 = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] auth_strategy                  = keystone {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] az_cache_duration              = 3600 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_availability_zone      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_host                   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_name                   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_stats_polling_interval = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[77081]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backup_api_class               = cinder.backup.api.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backup_name_template           = backup-%s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backup_use_same_host           = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backup_use_temp_snapshot       = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] chap_password                  = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] chap_username                  =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_internal_tenant_project_id = 9b818507e63d410bb9e1f015d626237a {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_internal_tenant_user_id = 8b661624f57d4d22936f067a0ae78948 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cloned_volume_same_az          = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cluster                        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] compression_format             = gzip {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] compute_api_class              = cinder.compute.nova.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] config_dir                     = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] config_source                  = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] control_exchange               = openstack {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] debug                          = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] default_availability_zone      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] default_group_type             = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] default_volume_type            = lvmdriver-1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] disk_geometry                  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_client_cert             = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_client_cert_key         = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_data_namespace          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_ssl_cert_path           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_ssl_cert_verify         = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] driver_use_ssl                 = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] enable_force_upload            = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] enable_new_services            = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] enable_unsupported_driver      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] enforce_multipath_for_image_xfer = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] filter_function                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_api_insecure            = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_api_ssl_compression     = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_ca_certificates_file    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_catalog_info            = image:glance:publicURL {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_certfile                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_keyfile                 = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_num_retries             = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance_request_timeout         = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] goodness_function              = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] graceful_shutdown_timeout      = 5 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] group_api_class                = cinder.group.api.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] host                           = devstack {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_compress_on_upload       = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_conversion_address_space_limit = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_conversion_cpu_limit     = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_conversion_disable       = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_upload_use_cinder_backend = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_upload_use_internal_tenant = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_volume_cache_enabled     = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_volume_cache_max_count   = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] image_volume_cache_max_size_gb = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] init_host_max_objects_retrieval = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] instance_format                = [instance: %(uuid)s]  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iscsi_target_flags             =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iscsi_write_cache              = on {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iser_helper                    = tgtadm {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iser_ip_address                = 192.168.122.151 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iser_port                      = 3260 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_color                      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_config_append              = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_dir                        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_file                       = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_options                    = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_rotate_interval            = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_rotate_interval_type       = days {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] log_rotation_type              = none {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] max_age                        = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] max_logfile_count              = 30 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] max_logfile_size_mb            = 200 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] max_over_subscription_ratio    = 20.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] message_reap_interval          = 86400 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] message_ttl                    = 2592000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] migration_create_volume_timeout_secs = 300 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] monkey_patch                   = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] monkey_patch_modules           = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] my_ip                          = 192.168.122.151 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] no_snapshot_gb_quota           = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] num_iser_scan_tries            = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] num_shell_tries                = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] num_volume_device_scan_tries   = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] nvmeof_conn_info_version       = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] nvmet_ns_id                    = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] nvmet_port_id                  = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_max_limit                = 1000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_ext_list          = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_listen_port       = 8776 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_use_ssl           = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] osapi_volume_workers           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] per_volume_size_limit          = -1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] periodic_fuzzy_delay           = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] periodic_interval              = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] public_endpoint                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] publish_errors                 = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_backup_gigabytes         = 1000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_backups                  = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_gigabytes                = 1000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_groups                   = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_snapshots                = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] quota_volumes                  = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] rate_limit_burst               = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] rate_limit_except_level        = CRITICAL {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] rate_limit_interval            = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] reinit_driver_count            = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[77081]: INFO cinder.volume.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] replication_device             = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] report_discard_supported       = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] report_interval                = 120 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] reservation_clean_interval     = 86400 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] reservation_expire             = 86400 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] reserved_image_namespaces      = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] reserved_percentage            = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] rpc_response_timeout           = 120 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] run_external_periodic_tasks    = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] scst_target_driver             = iscsi {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] scst_target_iqn_name           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_down_time              = 720 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] shell_completion               = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] snapshot_name_template         = snapshot-%s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] snapshot_same_host             = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] split_loggers                  = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] state_path                     = /opt/stack/data/cinder {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] storage_availability_zone      = nova {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] storage_protocol               = iSCSI {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] syslog_log_facility            = LOG_USER {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_helper                  = lioadm {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_ip_address              = 192.168.122.151 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_port                    = 3260 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_protocol                = iscsi {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] target_secondary_ip_addresses  = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] trace_flags                    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] transport_url                  = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] until_refresh                  = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_chap_auth                  = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_default_quota_class        = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_journal                    = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_json                       = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_multipath_for_image_xfer   = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_stderr                     = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] use_syslog                     = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] verify_glance_signatures       = enabled {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_api_class               = cinder.volume.api.API {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_backend_name            = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_clear                   = zero {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_clear_ionice            = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_clear_size              = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_copy_bps_limit          = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_dd_blocksize            = 1M {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_name_template           = volume-%s {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_service_inithost_offload = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volume_usage_audit_period      = month {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] zoning_mode                    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_concurrency.disable_process_locking = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.auth_section = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.auth_type   = password {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.auth_version = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.cache       = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.certfile    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.delay_auth_decision = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.http_connect_timeout = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.include_service_catalog = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.insecure    = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.interface   = public {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.keyfile     = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_password =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcache_username =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.region_name = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.service_token_roles_required = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.service_type = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.token_cache_time = 300 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.backend                  = dogpile.cache.null {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.backend_argument         = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.backend_expiration_time  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.config_prefix            = cache.oslo {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.debug_cache_backend      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.enable_retry_client      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.enable_socket_keepalive  = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.enabled                  = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.expiration_time          = 600 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.hashclient_retry_attempts = 2 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_dead_retry      = 300 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_pool_maxsize    = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_sasl_enabled    = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.password                 = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.proxies                  = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.redis_db                 = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.redis_sentinel_service_name = mymaster {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.redis_server             = localhost:6379 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.retry_attempts           = 2 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.retry_delay              = 0.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.socket_keepalive_count   = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.socket_keepalive_idle    = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.socket_keepalive_interval = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.socket_timeout           = 1.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.tls_allowed_ciphers      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.tls_cafile               = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.tls_certfile             = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.tls_enabled              = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.tls_keyfile              = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cache.username                 = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] coordination.backend_url       = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.asyncio_connection    = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.asyncio_slave_connection = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.backend               = sqlalchemy {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.connection            = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.connection_debug      = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.connection_parameters =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.connection_recycle_time = 3600 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.connection_trace      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.db_inc_retry_interval = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.db_max_retries        = 20 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.db_max_retry_interval = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.db_retry_interval     = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.max_overflow          = 50 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.max_pool_size         = 5 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.max_retries           = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.mysql_wsrep_sync_wait = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.pool_timeout          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.retry_interval        = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.slave_connection      = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.sqlite_synchronous    = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.synchronous_reader    = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] database.use_db_reconnect      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.connection_string     = messaging:// {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.enabled               = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.es_doc_type           = notification {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.es_scroll_size        = 10000 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.es_scroll_time        = 2m {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.filter_error_trace    = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.hmac_keys             = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.sentinel_service_name = mymaster {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.socket_timeout        = 0.1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.trace_requests        = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler.trace_sqlalchemy      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler_jaeger.process_tags   = {} {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler_jaeger.service_name_prefix = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] profiler_otlp.service_name_prefix = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.enforce_new_defaults = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.enforce_scope      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.policy_default_rule = default {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.policy_file        = policy.yaml {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.group          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.helper_command = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] privsep_osbrick.user           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.group         = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.helper_command = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] cinder_sys_admin.user          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.auth_section      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.auth_type         = password {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.cafile            = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.certfile          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.collect_timing    = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.insecure          = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.keyfile           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.send_service_user_token = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.split_loggers     = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] service_user.timeout           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.auth_section            = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.auth_type               = password {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.certfile                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.collect_timing          = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.insecure                = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.keyfile                 = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.region_name             = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.split_loggers           = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] glance.timeout                 = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.backend_availability_zone = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.chap_password = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.chap_username =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.disk_geometry = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_client_cert = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_client_cert_key = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_data_namespace = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.driver_use_ssl = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.enable_unsupported_driver = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.extra_capabilities = {} {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.filter_function = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.goodness_function = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iscsi_target_flags =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iscsi_write_cache = on {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iser_helper   = tgtadm {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iser_port     = 3260 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.lvm_share_target = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.lvm_type      = auto {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.num_shell_tries = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.nvmet_port_id = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.replication_device = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.report_discard_supported = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.reserved_percentage = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.scst_target_driver = iscsi {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.scst_target_iqn_name = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.storage_protocol = iSCSI {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_helper = tgtadm {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_port   = 3260 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_protocol = iscsi {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.trace_flags   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.unique_fqdn_network = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.use_chap_auth = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_backend_name = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_clear  = zero {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_clear_ionice = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_clear_size = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_reports.file_event_handler = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_reports.log_dir           = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.backend_availability_zone = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.backend_host       = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.chap_password      = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.chap_username      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.disk_geometry      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_client_cert = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_data_namespace = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.extra_capabilities = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.filter_function    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.goodness_function  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack sudo[77086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iser_helper        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iser_ip_address    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iser_port          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.iser_target_prefix = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack sudo[77086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.lvm_share_target   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.lvm_type           = auto {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.num_shell_tries    = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.replication_device = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.report_discard_supported = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.reserved_percentage = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.scst_target_driver = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.storage_protocol   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_helper      = lioadm {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_ip_address  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_port        = 3260 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.trace_flags        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.use_chap_auth      = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_clear       = zero {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_clear_size  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] lvmdriver-1.volumes_dir        = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl      = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_notifications.driver = [] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_notifications.retry = -1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] oslo_messaging_notifications.transport_url = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] key_manager.fixed_key          = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.barbican_api_version  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.barbican_endpoint     = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.barbican_endpoint_type = public {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.barbican_region_name  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.cafile                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.certfile              = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.collect_timing        = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.insecure              = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.keyfile               = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.number_of_retries     = 60 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.retry_delay           = 1 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.send_service_user_token = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.split_loggers         = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.timeout               = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.verify_ssl            = True {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican.verify_ssl_path       = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.auth_section = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.auth_type = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.cafile   = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.certfile = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.collect_timing = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.insecure = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.keyfile  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.split_loggers = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] barbican_service_user.timeout  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.approle_role_id          = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.approle_secret_id        = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.kv_mountpoint            = secret {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.kv_path                  = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.kv_version               = 2 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.namespace                = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.root_token_id            = **** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.ssl_ca_crt_file          = None {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.timeout                  = 60.0 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.use_ssl                  = False {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:26:21 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] ******************************************************************************** {{(pid=76914) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:26:22 devstack sudo[77086]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.730s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:22 devstack sudo[77224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:22 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:22 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.674s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:26:22 devstack cinder-volume[77081]: INFO cinder.brick.local_dev.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:22 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:23 devstack sudo[77498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:23 devstack sudo[77498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:23 devstack sudo[77498]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:23 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:23 devstack cinder-volume[77081]: DEBUG cinder.brick.local_dev.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77081) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 07 22:26:23 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:23 devstack sudo[77652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:23 devstack sudo[77652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:24 devstack sudo[77652]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:24 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.157s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:24 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:24 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:24 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:24 devstack sudo[77861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:24 devstack sudo[77861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:25 devstack sudo[77861]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:25 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.697s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:25 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:25 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:25 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:25 devstack sudo[77866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 07 22:26:25 devstack sudo[77866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:26 devstack sudo[77866]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:26 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.664s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:26 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:26 devstack sudo[77870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:26 devstack sudo[77870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:26 devstack sudo[77870]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:27 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:27 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:27 devstack sudo[77876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:27 devstack sudo[77876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:27 devstack sudo[77876]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:27 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:27 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:27 devstack sudo[77888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:27 devstack sudo[77888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:28 devstack sudo[77888]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:28 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:28 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:28 devstack sudo[77892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:28 devstack sudo[77892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:29 devstack sudo[77892]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:29 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.934s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:29 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:29 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:29 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:29 devstack sudo[77897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:29 devstack sudo[77897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:30 devstack sudo[77897]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.918s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:30 devstack cinder-volume[77081]: INFO cinder.volume.drivers.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 07 22:26:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:30 devstack sudo[78021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:30 devstack sudo[78021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:31 devstack sudo[78021]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.652s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:31 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:26:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:31 devstack sudo[78028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:31 devstack sudo[78028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:31 devstack cinder-volume[76914]: DEBUG dbcounter [-] [76914] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76914) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:26:31 devstack sudo[78028]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:31 devstack sudo[78032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:31 devstack sudo[78032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:32 devstack sudo[78032]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:32 devstack sudo[78035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:32 devstack sudo[78035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:32 devstack sudo[78035]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:32 devstack sudo[78039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:32 devstack sudo[78039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:33 devstack sudo[78039]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:33 devstack cinder-volume[77081]: INFO cinder.volume.driver [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG cinder.volume.driver [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77081) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG oslo_db.sqlalchemy.engines [None req-4429f65b-c67d-405f-8441-76d411489735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77081) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG dbcounter [-] [77081] Writer thread running {{(pid=77081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG cinder.db.api [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Building query based on filter {{(pid=77081) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG cinder.image.image_utils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77081) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:26:33 devstack cinder-volume[77081]: INFO cinder.keymgr.migration [None req-9242b28b-19ac-4162-a738-f04aa57ea5f4 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:26:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:33 devstack sudo[78043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:33 devstack sudo[78043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:34 devstack sudo[78043]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:34 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:34 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:34 devstack sudo[78049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:34 devstack sudo[78049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:34 devstack sudo[78049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:34 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:34 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:34 devstack sudo[78054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:34 devstack sudo[78054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:35 devstack sudo[78054]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:35 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:35 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:35 devstack sudo[78057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:35 devstack sudo[78057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:36 devstack sudo[78057]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:26:36 devstack cinder-volume[77081]: INFO cinder.volume.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Driver initialization completed successfully.
Jul 07 22:26:36 devstack cinder-volume[77081]: INFO cinder.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Initiating service 2 cleanup
Jul 07 22:26:36 devstack cinder-volume[77081]: INFO cinder.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Service 2 cleanup completed.
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG cinder.service [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Creating RPC server for service cinder-volume {{(pid=77081) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG cinder.service [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77081) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:26:36 devstack cinder-volume[77081]: INFO cinder.volume.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:36 devstack sudo[78066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:26:36 devstack sudo[78066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:36 devstack sudo[78066]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:36 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:36 devstack sudo[78069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:36 devstack sudo[78069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:37 devstack sudo[78069]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:37 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:37 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:37 devstack sudo[78075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:26:37 devstack sudo[78075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:38 devstack sudo[78075]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:38 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:38 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:26:38 devstack sudo[78078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:26:38 devstack sudo[78078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:26:38 devstack sudo[78078]: pam_unix(sudo:session): session closed for user root
Jul 07 22:26:38 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-4429f65b-c67d-405f-8441-76d411489735 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:26:38 devstack cinder-volume[77081]: INFO cinder.volume.manager [None req-4429f65b-c67d-405f-8441-76d411489735 None None] Driver post RPC initialization completed successfully.
Jul 07 22:26:46 devstack cinder-volume[77081]: DEBUG dbcounter [-] [77081] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:26:48 devstack cinder-volume[77081]: DEBUG dbcounter [-] [77081] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=77081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:27:30 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:27:30 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:27:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:31 devstack sudo[78176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:27:31 devstack sudo[78176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:31 devstack sudo[78176]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:31 devstack sudo[78179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:27:31 devstack sudo[78179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:32 devstack sudo[78179]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:32 devstack sudo[78182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:27:32 devstack sudo[78182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:32 devstack sudo[78182]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:27:33 devstack sudo[78185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:27:33 devstack sudo[78185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:27:33 devstack sudo[78185]: pam_unix(sudo:session): session closed for user root
Jul 07 22:27:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:27:33 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:27:33 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager._thread_info {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:27:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread count: 6 {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:27:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread info: [<_MainThread(MainThread, started 136888459649152)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136888352615168)>, <Thread(Thread-3 (stat_writer), started daemon 136888347918912)>, <Thread(Rabbit-heartbeat, started daemon 136888347576128)>, <Thread(Thread-5 (_runner), started daemon 136888347727168)>, <Thread(Thread-7 (_runner), started daemon 136888345725184)>] {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:28:30 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:28:30 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:28:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:30 devstack sudo[79725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:28:30 devstack sudo[79725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:31 devstack sudo[79725]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:31 devstack sudo[79728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:28:31 devstack sudo[79728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:32 devstack sudo[79728]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:32 devstack sudo[79736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:28:32 devstack sudo[79736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:32 devstack sudo[79736]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:28:32 devstack sudo[79751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:28:32 devstack sudo[79751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:28:33 devstack sudo[79751]: pam_unix(sudo:session): session closed for user root
Jul 07 22:28:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:28:33 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:28:48 devstack cinder-volume[77081]: DEBUG dbcounter [-] [77081] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:29:30 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:29:30 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:29:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:31 devstack sudo[83256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:29:31 devstack sudo[83256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:31 devstack sudo[83256]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:31 devstack sudo[83259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:29:31 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:32 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:32 devstack sudo[83262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:29:32 devstack sudo[83262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:32 devstack sudo[83262]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.648s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:29:32 devstack sudo[83265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:29:32 devstack sudo[83265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:29:33 devstack sudo[83265]: pam_unix(sudo:session): session closed for user root
Jul 07 22:29:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:29:33 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:29:33 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager._thread_info {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:29:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread count: 6 {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:29:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread info: [<_MainThread(MainThread, started 136888459649152)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136888352615168)>, <Thread(Thread-3 (stat_writer), started daemon 136888347918912)>, <Thread(Rabbit-heartbeat, started daemon 136888347576128)>, <Thread(Thread-5 (_runner), started daemon 136888347727168)>, <Thread(Thread-7 (_runner), started daemon 136888345725184)>] {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:30:30 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:30:30 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:30:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:31 devstack sudo[84732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:30:31 devstack sudo[84732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:31 devstack sudo[84732]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.724s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:31 devstack sudo[84757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:30:31 devstack sudo[84757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:32 devstack sudo[84757]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:32 devstack sudo[84773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:30:32 devstack sudo[84773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:33 devstack sudo[84773]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.734s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:30:33 devstack sudo[84803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:30:33 devstack sudo[84803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:30:33 devstack sudo[84803]: pam_unix(sudo:session): session closed for user root
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager._thread_info {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread count: 6 {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:30:33 devstack cinder-volume[77081]: DEBUG cinder.volume.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] thread info: [<_MainThread(MainThread, started 136888459649152)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136888352615168)>, <Thread(Thread-3 (stat_writer), started daemon 136888347918912)>, <Thread(Rabbit-heartbeat, started daemon 136888347576128)>, <Thread(Thread-5 (_runner), started daemon 136888347727168)>, <Thread(Thread-7 (_runner), started daemon 136888345725184)>] {{(pid=77081) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:30:48 devstack cinder-volume[77081]: DEBUG dbcounter [-] [77081] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77081) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:31:30 devstack cinder-volume[77081]: DEBUG oslo_service.periodic_task [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77081) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:31:30 devstack cinder-volume[77081]: DEBUG cinder.volume.drivers.lvm [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Updating volume stats {{(pid=77081) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 07 22:31:30 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:31 devstack sudo[86040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 07 22:31:31 devstack sudo[86040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:31 devstack sudo[86040]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:31 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:31 devstack sudo[86046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:31:31 devstack sudo[86046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:32 devstack sudo[86046]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:32 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:32 devstack sudo[86050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 07 22:31:32 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:33 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.761s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:31:33 devstack sudo[86068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 07 22:31:33 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:31:33 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root
Jul 07 22:31:33 devstack cinder-volume[77081]: DEBUG oslo_concurrency.processutils [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.718s {{(pid=77081) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:31:33 devstack cinder-volume[77081]: DEBUG cinder.manager [None req-5a36bb4d-cd42-4ec8-bc29-9a6bfe7b6239 None None] Notifying Schedulers of capabilities ... {{(pid=77081) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:23 devstack cinder-volume[76914]: INFO oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Caught SIGTERM, stopping children
Jul 07 22:32:23 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Acquiring lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:23 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Acquired lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:23 devstack cinder-volume[76914]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Releasing lock "singleton_lock" {{(pid=76914) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:23 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Stop services. {{(pid=76914) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 22:32:23 devstack cinder-volume[76914]: DEBUG oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Killing children. {{(pid=76914) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 22:32:23 devstack cinder-volume[76914]: INFO oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Waiting on 1 children to exit
Jul 07 22:32:26 devstack cinder-volume[77081]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Acquiring lock "singleton_lock" {{(pid=77081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:26 devstack cinder-volume[77081]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Acquired lock "singleton_lock" {{(pid=77081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:26 devstack cinder-volume[77081]: DEBUG oslo_concurrency.lockutils [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Releasing lock "singleton_lock" {{(pid=77081) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:26 devstack cinder-volume[77081]: WARNING amqp [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:32:26 devstack cinder-volume[77081]: WARNING amqp [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:32:26 devstack cinder-volume[76914]: INFO oslo_service.backend._eventlet.service [None req-4cefccf6-2080-4645-a48f-3a6274dfc5ad None None] Child 77081 exited with status 0
Jul 07 22:32:26 devstack cinder-volume[87303]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:32:26 devstack cinder-volume[87303]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:32:26 devstack cinder-volume[87303]: we strongly recommend against using it for new projects.
Jul 07 22:32:26 devstack cinder-volume[87303]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:32:26 devstack cinder-volume[87303]: framework.  For more detail see
Jul 07 22:32:26 devstack cinder-volume[87303]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:32:26 devstack cinder-volume[87303]:   import eventlet  # noqa
Jul 07 22:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:28 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO dbcounter [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Registered counter for database cinder
Jul 07 22:32:29 devstack cinder-volume[87303]: DEBUG oslo_db.sqlalchemy.engines [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:29 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writer thread running {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO cinder.rpc [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO cinder.rpc [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:32:29 devstack cinder-volume[87303]: DEBUG oslo_db.sqlalchemy.engines [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Determined volume DB was empty at startup.
Jul 07 22:32:29 devstack cinder-volume[87303]: DEBUG cinder.volume.manager [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87303) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 07 22:32:29 devstack cinder-volume[87303]: WARNING stevedore.named [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:32:29 devstack cinder-volume[87303]: WARNING castellan.key_manager [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:32:29 devstack cinder-volume[87303]: WARNING cinder.keymgr.conf_key_mgr [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:32:29 devstack cinder-volume[87303]: INFO cinder.volume.manager [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_db.sqlalchemy.engines [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87303) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:30 devstack cinder-volume[87303]: INFO oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Starting 1 workers
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Started child 87510 {{(pid=87303) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Full set of CONF: {{(pid=87303) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] ******************************************************************************** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Configuration options gathered from: {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] ================================================================================ {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] allow_availability_zone_fallback = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] allow_compression_on_image_upload = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] allowed_direct_url_schemes     = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] api_rate_limit                 = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] auth_strategy                  = keystone {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_availability_zone      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_host                   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87510]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_name                   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_stats_polling_interval = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backup_api_class               = cinder.backup.api.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backup_name_template           = backup-%s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backup_use_same_host           = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backup_use_temp_snapshot       = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] chap_password                  = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] chap_username                  =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_internal_tenant_project_id = 9b818507e63d410bb9e1f015d626237a {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_internal_tenant_user_id = 8b661624f57d4d22936f067a0ae78948 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cluster                        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] compression_format             = gzip {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] compute_api_class              = cinder.compute.nova.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] config_dir                     = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] config_source                  = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] control_exchange               = openstack {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] debug                          = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] default_availability_zone      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] default_group_type             = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] default_volume_type            = QuobyteHD {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] disk_geometry                  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_client_cert             = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_client_cert_key         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_data_namespace          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_ssl_cert_path           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_ssl_cert_verify         = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] driver_use_ssl                 = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] enable_new_services            = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] enable_unsupported_driver      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] enabled_backends               = ['QuobyteHD'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] enforce_multipath_for_image_xfer = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] filter_function                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_api_insecure            = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_api_ssl_compression     = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_ca_certificates_file    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_catalog_info            = image:glance:publicURL {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_certfile                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_keyfile                 = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_num_retries             = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance_request_timeout         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] goodness_function              = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] graceful_shutdown_timeout      = 5 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] group_api_class                = cinder.group.api.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] host                           = devstack {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_compress_on_upload       = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_conversion_address_space_limit = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_conversion_cpu_limit     = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_conversion_disable       = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_upload_use_cinder_backend = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_upload_use_internal_tenant = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_volume_cache_enabled     = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_volume_cache_max_count   = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] image_volume_cache_max_size_gb = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.remotefs [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87510) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] init_host_max_objects_retrieval = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] instance_format                = [instance: %(uuid)s]  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iscsi_target_flags             =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iscsi_write_cache              = on {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iser_helper                    = tgtadm {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iser_ip_address                = 192.168.122.151 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iser_port                      = 3260 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_color                      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_config_append              = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_dir                        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_file                       = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_options                    = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_rotate_interval            = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_rotate_interval_type       = days {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] log_rotation_type              = none {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] max_age                        = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] max_logfile_count              = 30 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] max_logfile_size_mb            = 200 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] max_over_subscription_ratio    = 20.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] message_reap_interval          = 86400 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] message_ttl                    = 2592000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] migration_create_volume_timeout_secs = 300 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] monkey_patch                   = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] monkey_patch_modules           = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] my_ip                          = 192.168.122.151 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] no_snapshot_gb_quota           = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] num_iser_scan_tries            = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] num_shell_tries                = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] num_volume_device_scan_tries   = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] nvmeof_conn_info_version       = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] nvmet_ns_id                    = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] nvmet_port_id                  = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_max_limit                = 1000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_ext_list          = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_listen_port       = 8776 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_use_ssl           = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] osapi_volume_workers           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] per_volume_size_limit          = -1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] periodic_fuzzy_delay           = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] periodic_interval              = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] public_endpoint                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] publish_errors                 = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_backup_gigabytes         = 1000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_backups                  = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_gigabytes                = 1000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_groups                   = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_snapshots                = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] quota_volumes                  = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] rate_limit_burst               = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] rate_limit_except_level        = CRITICAL {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] rate_limit_interval            = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] reinit_driver_count            = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] replication_device             = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] report_discard_supported       = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] report_interval                = 120 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] reservation_clean_interval     = 86400 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] reservation_expire             = 86400 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] reserved_image_namespaces      = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] reserved_percentage            = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] rpc_response_timeout           = 120 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] run_external_periodic_tasks    = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] scst_target_driver             = iscsi {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] scst_target_iqn_name           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_down_time              = 720 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] shell_completion               = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] snapshot_name_template         = snapshot-%s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] split_loggers                  = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] state_path                     = /opt/stack/data/cinder {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] storage_availability_zone      = nova {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] storage_protocol               = iSCSI {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] syslog_log_facility            = LOG_USER {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_helper                  = lioadm {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_ip_address              = 192.168.122.151 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_port                    = 3260 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_protocol                = iscsi {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] target_secondary_ip_addresses  = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] trace_flags                    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] transport_url                  = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] until_refresh                  = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_chap_auth                  = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_default_quota_class        = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_journal                    = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_json                       = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_multipath_for_image_xfer   = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_stderr                     = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] use_syslog                     = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] verify_glance_signatures       = enabled {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_api_class               = cinder.volume.api.API {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_backend_name            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_clear                   = zero {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_clear_ionice            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_clear_size              = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_copy_bps_limit          = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_dd_blocksize            = 1M {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_name_template           = volume-%s {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_service_inithost_offload = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volume_usage_audit_period      = month {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] zoning_mode                    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_concurrency.disable_process_locking = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.auth_section = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.auth_type   = password {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.auth_version = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.cache       = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.certfile    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.include_service_catalog = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.insecure    = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.interface   = public {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.keyfile     = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_password =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcache_username =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.region_name = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.service_type = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.backend                  = dogpile.cache.null {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.backend_argument         = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.backend_expiration_time  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.config_prefix            = cache.oslo {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.debug_cache_backend      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.enable_retry_client      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.enable_socket_keepalive  = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.enabled                  = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.expiration_time          = 600 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.hashclient_retry_attempts = 2 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_dead_retry      = 300 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_pool_maxsize    = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_sasl_enabled    = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.password                 = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.proxies                  = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.redis_db                 = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.redis_server             = localhost:6379 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.retry_attempts           = 2 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.retry_delay              = 0.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.socket_keepalive_count   = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.socket_keepalive_idle    = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.socket_keepalive_interval = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.socket_timeout           = 1.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.tls_allowed_ciphers      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.tls_cafile               = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.tls_certfile             = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.tls_enabled              = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.tls_keyfile              = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cache.username                 = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] coordination.backend_url       = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.asyncio_connection    = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.asyncio_slave_connection = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.backend               = sqlalchemy {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.connection            = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.connection_debug      = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.connection_parameters =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.connection_recycle_time = 3600 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.connection_trace      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.db_inc_retry_interval = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.db_max_retries        = 20 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.db_max_retry_interval = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.db_retry_interval     = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.max_overflow          = 50 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.max_pool_size         = 5 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.max_retries           = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.mysql_wsrep_sync_wait = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.pool_timeout          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.retry_interval        = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.slave_connection      = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.sqlite_synchronous    = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.synchronous_reader    = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] database.use_db_reconnect      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.connection_string     = messaging:// {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.enabled               = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.es_doc_type           = notification {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.es_scroll_size        = 10000 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.es_scroll_time        = 2m {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.filter_error_trace    = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.hmac_keys             = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.sentinel_service_name = mymaster {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.socket_timeout        = 0.1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.trace_requests        = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler.trace_sqlalchemy      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler_jaeger.process_tags   = {} {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler_jaeger.service_name_prefix = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] profiler_otlp.service_name_prefix = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.enforce_new_defaults = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.enforce_scope      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.policy_default_rule = default {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.policy_file        = policy.yaml {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.group          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.helper_command = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] privsep_osbrick.user           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.group         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.helper_command = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] cinder_sys_admin.user          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.auth_section      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.auth_type         = password {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.cafile            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.certfile          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.collect_timing    = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.insecure          = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.keyfile           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.send_service_user_token = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.split_loggers     = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] service_user.timeout           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.auth_section            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.auth_type               = password {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.certfile                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.collect_timing          = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.insecure                = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.keyfile                 = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.region_name             = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.split_loggers           = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] glance.timeout                 = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.backend_availability_zone = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.chap_password = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87510) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 22:32:30 devstack cinder-volume[87510]: WARNING cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 22:32:30 devstack cinder-volume[87510]: WARNING cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.chap_username =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.disk_geometry = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_client_cert = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_client_cert_key = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_data_namespace = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.driver_use_ssl = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Running cmd (subprocess): mount.quobyte {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.extra_capabilities = {} {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.filter_function = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.goodness_function = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iscsi_target_flags =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iscsi_write_cache = on {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iser_helper   = tgtadm {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iser_port     = 3260 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_host      =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_login     = admin {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_mount_options = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_password  = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_private_key =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_share_path =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.num_shell_tries = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.quobyte_volume_url = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.replication_device = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.report_discard_supported = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.reserved_percentage = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_helper = tgtadm {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_port   = 3260 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_protocol = iscsi {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.trace_flags   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.unique_fqdn_network = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.use_chap_auth = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_backend_name = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_clear  = zero {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_clear_ionice = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_clear_size = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_reports.file_event_handler = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_reports.log_dir           = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.backend_availability_zone = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.backend_host         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.chap_password        = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.chap_username        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.chiscsi_conf         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.disk_geometry        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_client_cert   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_data_namespace = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.driver_use_ssl       = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.extra_capabilities   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.filter_function      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.goodness_function    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iser_helper          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iser_ip_address      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iser_port            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.iser_target_prefix   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_host             = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_login            = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_mount_options    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_password         = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_private_key      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_share_path       = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_ssh_port         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.num_shell_tries      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.nvmet_port_id        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.replication_device   = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.report_discard_supported = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.reserved_percentage  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.scst_target_driver   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.storage_protocol     = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_helper        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_ip_address    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_port          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_prefix        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_protocol      = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.trace_flags          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.use_chap_auth        = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_clear         = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_clear_size    = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] QuobyteHD.volumes_dir          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl      = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_notifications.driver = [] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_notifications.retry = -1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] key_manager.fixed_key          = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.barbican_api_version  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.barbican_endpoint     = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.barbican_endpoint_type = public {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.barbican_region_name  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.cafile                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.certfile              = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.collect_timing        = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.insecure              = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.keyfile               = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.number_of_retries     = 60 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.retry_delay           = 1 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.send_service_user_token = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.split_loggers         = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.timeout               = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.verify_ssl            = True {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican.verify_ssl_path       = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.auth_section = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.auth_type = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.cafile   = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.certfile = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.collect_timing = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.insecure = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.keyfile  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.split_loggers = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] barbican_service_user.timeout  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.approle_role_id          = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.approle_secret_id        = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.kv_mountpoint            = secret {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.kv_path                  = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.kv_version               = 2 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.namespace                = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.root_token_id            = **** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.ssl_ca_crt_file          = None {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.timeout                  = 60.0 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.use_ssl                  = False {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:30 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] ******************************************************************************** {{(pid=87303) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:32:30 devstack quobyte-client[87517]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 22:32:30 devstack quobyte-client[87517]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] CMD "mount.quobyte" returned: 1 in 0.126s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=87510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:30 devstack cinder-volume[87510]: INFO cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 ...
Jul 07 22:32:30 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 -c /etc/quobyte/client-cinder.cfg {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:30 devstack sudo[87518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 -c /etc/quobyte/client-cinder.cfg
Jul 07 22:32:30 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:31 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.794s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:31 devstack cinder-volume[87510]: INFO cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 succeeded
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=87510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.808s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:31 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:31 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:31 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.672s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:31 devstack cinder-volume[87510]: INFO cinder.volume.driver [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG cinder.volume.driver [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6875915527344, 'free_capacity_gb': 1775.6875915527344, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87510) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:32:31 devstack cinder-volume[87510]: DEBUG oslo_db.sqlalchemy.engines [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87510) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG dbcounter [-] [87510] Writer thread running {{(pid=87510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.db.api [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Building query based on filter {{(pid=87510) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.image.image_utils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87510) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:32:32 devstack cinder-volume[87510]: INFO cinder.keymgr.migration [None req-c9ac751a-7a38-4acc-ab84-09e2634c5c8a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=87510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=87510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:32 devstack sudo[87594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:32 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:32 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.655s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Notifying Schedulers of capabilities ... {{(pid=87510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:32 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Driver initialization completed successfully.
Jul 07 22:32:32 devstack cinder-volume[87510]: INFO cinder.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Initiating service 3 cleanup
Jul 07 22:32:32 devstack cinder-volume[87510]: INFO cinder.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Service 3 cleanup completed.
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.service [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Creating RPC server for service cinder-volume {{(pid=87510) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.service [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87510) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:32:32 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=87510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=87510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:32 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:32 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:32 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:33 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:33 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.854s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:33 devstack cinder-volume[87510]: INFO cinder.volume.manager [None req-bf217973-a238-4afd-84b1-36d7eb786d5e None None] Driver post RPC initialization completed successfully.
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=87510) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG cinder.volume.drivers.quobyte [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=87510) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87510) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:37 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:37 devstack sudo[87722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:37 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:38 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:38 devstack cinder-volume[87510]: DEBUG oslo_concurrency.processutils [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.632s {{(pid=87510) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:38 devstack cinder-volume[87510]: DEBUG cinder.manager [None req-1be8643c-c49a-4748-a6c4-bd936312ae83 None None] Notifying Schedulers of capabilities ... {{(pid=87510) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG dbcounter [-] [87303] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87303) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:32:40 devstack cinder-volume[87303]: INFO oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Caught SIGTERM, stopping children
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Acquiring lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Acquired lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Releasing lock "singleton_lock" {{(pid=87303) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Stop services. {{(pid=87303) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 07 22:32:40 devstack cinder-volume[87303]: DEBUG oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Killing children. {{(pid=87303) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 07 22:32:40 devstack cinder-volume[87303]: INFO oslo_service.backend._eventlet.service [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Waiting on 1 children to exit
Jul 07 22:32:42 devstack cinder-volume[87510]: DEBUG dbcounter [-] [87510] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:32:43 devstack cinder-volume[87510]: DEBUG dbcounter [-] [87510] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87510) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:32:45 devstack cinder-volume[87510]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 07 22:32:46 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Acquiring lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:46 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Acquired lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:46 devstack cinder-volume[87510]: DEBUG oslo_concurrency.lockutils [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Releasing lock "singleton_lock" {{(pid=87510) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:46 devstack cinder-volume[87510]: WARNING amqp [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:32:46 devstack cinder-volume[87510]: WARNING amqp [None req-c46041f7-4c39-4026-bc94-688572d7fc1f None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 07 22:32:46 devstack cinder-volume[87815]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 07 22:32:46 devstack cinder-volume[87815]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:32:46 devstack cinder-volume[87815]: we strongly recommend against using it for new projects.
Jul 07 22:32:46 devstack cinder-volume[87815]: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:32:46 devstack cinder-volume[87815]: framework.  For more detail see
Jul 07 22:32:46 devstack cinder-volume[87815]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:32:46 devstack cinder-volume[87815]:   import eventlet  # noqa
Jul 07 22:32:48 devstack cinder-volume[87815]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 07 22:32:48 devstack cinder-volume[87815]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 07 22:32:48 devstack cinder-volume[87815]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87815) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 07 22:32:49 devstack cinder-volume[87815]: INFO dbcounter [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Registered counter for database cinder
Jul 07 22:32:49 devstack cinder-volume[87815]: DEBUG oslo_db.sqlalchemy.engines [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG dbcounter [-] [87815] Writer thread running {{(pid=87815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:32:50 devstack cinder-volume[87815]: INFO cinder.rpc [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 07 22:32:50 devstack cinder-volume[87815]: INFO cinder.rpc [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_db.sqlalchemy.engines [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:50 devstack cinder-volume[87815]: INFO cinder.volume.manager [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Determined volume DB was empty at startup.
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG cinder.volume.manager [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87815) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 07 22:32:50 devstack cinder-volume[87815]: WARNING stevedore.named [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 07 22:32:50 devstack cinder-volume[87815]: WARNING castellan.key_manager [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:32:50 devstack cinder-volume[87815]: WARNING cinder.keymgr.conf_key_mgr [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 07 22:32:50 devstack cinder-volume[87815]: INFO cinder.volume.manager [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_db.sqlalchemy.engines [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87815) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:50 devstack cinder-volume[87815]: INFO oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Starting 1 workers
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Started child 88152 {{(pid=87815) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Full set of CONF: {{(pid=87815) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] ******************************************************************************** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] Configuration options gathered from: {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] ================================================================================ {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] allow_availability_zone_fallback = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] allow_compression_on_image_upload = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[88152]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] allowed_direct_url_schemes     = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] api_rate_limit                 = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] auth_strategy                  = keystone {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_availability_zone      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_host                   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_name                   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_stats_polling_interval = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backup_api_class               = cinder.backup.api.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backup_name_template           = backup-%s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backup_use_same_host           = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backup_use_temp_snapshot       = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] chap_password                  = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] chap_username                  =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_internal_tenant_project_id = 9b818507e63d410bb9e1f015d626237a {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_internal_tenant_user_id = 8b661624f57d4d22936f067a0ae78948 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cluster                        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] compression_format             = gzip {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] compute_api_class              = cinder.compute.nova.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] config_dir                     = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] config_source                  = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] control_exchange               = openstack {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] debug                          = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] default_availability_zone      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] default_group_type             = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] default_volume_type            = QuobyteHD {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] disk_geometry                  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_client_cert             = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_client_cert_key         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_data_namespace          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_ssl_cert_path           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_ssl_cert_verify         = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] driver_use_ssl                 = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] enable_new_services            = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] enable_unsupported_driver      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] enabled_backends               = ['QuobyteHD'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] enforce_multipath_for_image_xfer = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] filter_function                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_api_insecure            = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_api_servers             = ['http://192.168.122.151/image'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_api_ssl_compression     = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_ca_certificates_file    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_catalog_info            = image:glance:publicURL {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_certfile                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_keyfile                 = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_num_retries             = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance_request_timeout         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] goodness_function              = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] graceful_shutdown_timeout      = 5 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] group_api_class                = cinder.group.api.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] host                           = devstack {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_compress_on_upload       = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_conversion_address_space_limit = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_conversion_cpu_limit     = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_conversion_disable       = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_upload_use_cinder_backend = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_upload_use_internal_tenant = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_volume_cache_enabled     = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_volume_cache_max_count   = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] image_volume_cache_max_size_gb = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] init_host_max_objects_retrieval = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] instance_format                = [instance: %(uuid)s]  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iscsi_target_flags             =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iscsi_write_cache              = on {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iser_helper                    = tgtadm {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iser_ip_address                = 192.168.122.151 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iser_port                      = 3260 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_color                      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_config_append              = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_dir                        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_file                       = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_options                    = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_rotate_interval            = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_rotate_interval_type       = days {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] log_rotation_type              = none {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] max_age                        = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] max_logfile_count              = 30 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] max_logfile_size_mb            = 200 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] max_over_subscription_ratio    = 20.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] message_reap_interval          = 86400 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] message_ttl                    = 2592000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] migration_create_volume_timeout_secs = 300 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] monkey_patch                   = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] monkey_patch_modules           = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] my_ip                          = 192.168.122.151 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] no_snapshot_gb_quota           = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] num_iser_scan_tries            = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] num_shell_tries                = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] num_volume_device_scan_tries   = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] nvmeof_conn_info_version       = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] nvmet_ns_id                    = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] nvmet_port_id                  = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_max_limit                = 1000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_ext_list          = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_listen            = 0.0.0.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_listen_port       = 8776 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_use_ssl           = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88152) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] osapi_volume_workers           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] per_volume_size_limit          = -1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] periodic_fuzzy_delay           = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] periodic_interval              = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] project_id_regex               = [0-9a-f\-]+ {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] public_endpoint                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] publish_errors                 = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_backup_gigabytes         = 1000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_backups                  = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_gigabytes                = 1000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_groups                   = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_snapshots                = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] quota_volumes                  = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] rate_limit_burst               = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] rate_limit_except_level        = CRITICAL {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] rate_limit_interval            = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] reinit_driver_count            = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] replication_device             = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] report_discard_supported       = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] report_interval                = 120 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] reservation_clean_interval     = 86400 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] reservation_expire             = 86400 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] reserved_image_namespaces      = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] reserved_percentage            = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] rpc_response_timeout           = 120 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] run_external_periodic_tasks    = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] scst_target_driver             = iscsi {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] scst_target_iqn_name           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_down_time              = 720 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] shell_completion               = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] snapshot_name_template         = snapshot-%s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] split_loggers                  = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] state_path                     = /opt/stack/data/cinder {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] storage_availability_zone      = nova {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] storage_protocol               = iSCSI {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] syslog_log_facility            = LOG_USER {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_helper                  = lioadm {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_ip_address              = 192.168.122.151 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_port                    = 3260 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_protocol                = iscsi {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] target_secondary_ip_addresses  = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] trace_flags                    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] transfer_api_class             = cinder.transfer.api.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] transport_url                  = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] until_refresh                  = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_chap_auth                  = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_default_quota_class        = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_journal                    = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_json                       = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_multipath_for_image_xfer   = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_stderr                     = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] use_syslog                     = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] verify_glance_signatures       = enabled {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_api_class               = cinder.volume.api.API {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_backend_name            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_clear                   = zero {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_clear_ionice            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_clear_size              = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_copy_bps_limit          = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_dd_blocksize            = 1M {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_name_template           = volume-%s {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_service_inithost_offload = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volume_usage_audit_period      = month {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] zoning_mode                    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_concurrency.disable_process_locking = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.auth_section = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.auth_type   = password {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.auth_version = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.cache       = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.certfile    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.delay_auth_decision = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.http_connect_timeout = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.include_service_catalog = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.insecure    = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.interface   = public {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.keyfile     = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_password =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcache_username =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.region_name = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.service_token_roles_required = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.service_type = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.token_cache_time = 300 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.151/identity {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.backend                  = dogpile.cache.null {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.backend_argument         = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.backend_expiration_time  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.config_prefix            = cache.oslo {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.debug_cache_backend      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.enable_retry_client      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.enable_socket_keepalive  = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.enabled                  = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.expiration_time          = 600 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.hashclient_retry_attempts = 2 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_dead_retry      = 300 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_pool_maxsize    = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_sasl_enabled    = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.password                 = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.proxies                  = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.redis_db                 = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.redis_sentinel_service_name = mymaster {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.redis_server             = localhost:6379 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.retry_attempts           = 2 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.retry_delay              = 0.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.socket_keepalive_count   = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.socket_keepalive_idle    = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.socket_keepalive_interval = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.socket_timeout           = 1.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.tls_allowed_ciphers      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.tls_cafile               = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.tls_certfile             = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.tls_enabled              = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.tls_keyfile              = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cache.username                 = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] coordination.backend_url       = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.asyncio_connection    = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.asyncio_slave_connection = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.backend               = sqlalchemy {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.connection            = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.connection_debug      = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.connection_parameters =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.connection_recycle_time = 3600 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.connection_trace      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.db_inc_retry_interval = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.db_max_retries        = 20 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.db_max_retry_interval = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.db_retry_interval     = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.max_overflow          = 50 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.max_pool_size         = 5 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.max_retries           = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.mysql_wsrep_sync_wait = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.pool_timeout          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.retry_interval        = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.slave_connection      = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.sqlite_synchronous    = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.synchronous_reader    = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] database.use_db_reconnect      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.connection_string     = messaging:// {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.enabled               = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.es_doc_type           = notification {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.es_scroll_size        = 10000 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.es_scroll_time        = 2m {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.filter_error_trace    = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.hmac_keys             = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.sentinel_service_name = mymaster {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.socket_timeout        = 0.1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.trace_requests        = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler.trace_sqlalchemy      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler_jaeger.process_tags   = {} {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler_jaeger.service_name_prefix = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] profiler_otlp.service_name_prefix = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.enforce_new_defaults = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.enforce_scope      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.policy_default_rule = default {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.policy_file        = policy.yaml {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_policy.remote_timeout     = 60.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.group          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.helper_command = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] privsep_osbrick.user           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.group         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.helper_command = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] cinder_sys_admin.user          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.auth_section      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.auth_type         = password {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.cafile            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.certfile          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.collect_timing    = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.insecure          = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.keyfile           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.send_service_user_token = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.split_loggers     = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] service_user.timeout           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.auth_section            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.auth_type               = password {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.certfile                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.collect_timing          = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.insecure                = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.keyfile                 = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.region_name             = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.split_loggers           = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] glance.timeout                 = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.backend_availability_zone = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.chap_password = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.chap_username =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.disk_geometry = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_client_cert = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_client_cert_key = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_data_namespace = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.driver_use_ssl = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.enable_unsupported_driver = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.extra_capabilities = {} {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.filter_function = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.goodness_function = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iscsi_target_flags =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iscsi_write_cache = on {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iser_helper   = tgtadm {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iser_ip_address = 192.168.122.151 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iser_port     = 3260 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_host      =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_login     = admin {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_mount_options = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_password  = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_private_key =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_share_path =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_ssh_port  = 22 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.num_shell_tries = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.nvmet_port_id = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_client_cfg = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.quobyte_volume_url = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.replication_device = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.report_discard_supported = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.reserved_percentage = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.scst_target_driver = iscsi {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.scst_target_iqn_name = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.storage_protocol = iSCSI {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_helper = tgtadm {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_ip_address = 192.168.122.151 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_port   = 3260 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_protocol = iscsi {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.trace_flags   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.unique_fqdn_network = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.use_chap_auth = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_backend_name = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_clear  = zero {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_clear_ionice = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_clear_size = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_reports.file_event_handler = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_reports.log_dir           = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.backend_availability_zone = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.backend_host         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.chap_password        = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.chap_username        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.chiscsi_conf         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.disk_geometry        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_client_cert   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_client_cert_key = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_data_namespace = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.driver_use_ssl       = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.extra_capabilities   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.filter_function      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.goodness_function    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iscsi_target_flags   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iscsi_write_cache    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iser_helper          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iser_ip_address      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iser_port            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.iser_target_prefix   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_host             = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_login            = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_mount_options    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_password         = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_private_key      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_share_path       = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_ssh_port         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.num_shell_tries      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nvmet_ns_id          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.nvmet_port_id        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.replication_device   = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.report_discard_supported = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.reserved_percentage  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.scst_target_driver   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.storage_protocol     = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_helper        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_ip_address    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_port          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_prefix        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_protocol      = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.trace_flags          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.unique_fqdn_network  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.use_chap_auth        = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_clear         = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_clear_ionice  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_clear_size    = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] QuobyteHD.volumes_dir          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl      = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.ssl_version =  {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_notifications.driver = [] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_notifications.retry = -1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] oslo_messaging_notifications.transport_url = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] key_manager.fixed_key          = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.barbican_api_version  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.barbican_endpoint     = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.barbican_endpoint_type = public {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.barbican_region_name  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.cafile                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.certfile              = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.collect_timing        = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.insecure              = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.keyfile               = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.number_of_retries     = 60 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.retry_delay           = 1 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.send_service_user_token = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.split_loggers         = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.timeout               = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.verify_ssl            = True {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican.verify_ssl_path       = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.auth_section = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.auth_type = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.cafile   = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.certfile = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.collect_timing = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.insecure = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.keyfile  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.split_loggers = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] barbican_service_user.timeout  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.approle_role_id          = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.approle_secret_id        = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.kv_mountpoint            = secret {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.kv_path                  = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.kv_version               = 2 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.namespace                = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.root_token_id            = **** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.ssl_ca_crt_file          = None {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.timeout                  = 60.0 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.use_ssl                  = False {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 07 22:32:50 devstack cinder-volume[87815]: DEBUG oslo_service.backend._eventlet.service [None req-f7cd58c4-e9e0-4a11-83a8-f90113d7cdcd None None] ******************************************************************************** {{(pid=87815) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88152) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 07 22:32:50 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 07 22:32:50 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Running cmd (subprocess): mount.quobyte {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:50 devstack quobyte-client[88153]: Reading configuration file: /etc/quobyte/client.cfg
Jul 07 22:32:50 devstack quobyte-client[88153]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:50 devstack sudo[88154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:50 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:51 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.642s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:51 devstack cinder-volume[88152]: INFO cinder.volume.driver [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Driver hasn't implemented _init_vendor_properties()
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.volume.driver [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.687099456787, 'free_capacity_gb': 1775.687099456787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88152) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_db.sqlalchemy.engines [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88152) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writer thread running {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.db.api [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Building query based on filter {{(pid=88152) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88152) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:51 devstack cinder-volume[88152]: INFO cinder.keymgr.migration [None req-02523bfb-3e7e-4ff0-ba13-db481e641010 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 07 22:32:51 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:51 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:51 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.638s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:51 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:32:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Driver initialization completed successfully.
Jul 07 22:32:52 devstack cinder-volume[88152]: INFO cinder.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Initiating service 3 cleanup
Jul 07 22:32:52 devstack cinder-volume[88152]: INFO cinder.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Service 3 cleanup completed.
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG cinder.service [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Creating RPC server for service cinder-volume {{(pid=88152) start /opt/stack/cinder/cinder/service.py:231}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG cinder.service [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88152) start /opt/stack/cinder/cinder/service.py:237}}
Jul 07 22:32:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:32:52 devstack sudo[88221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:32:52 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:32:52 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root
Jul 07 22:32:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.625s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:32:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9ebde5c9-4517-4c4c-8a88-e03fceb203de None None] Driver post RPC initialization completed successfully.
Jul 07 22:33:00 devstack cinder-volume[87815]: DEBUG dbcounter [-] [87815] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87815) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:33:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=10,cinder:UPDATE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:33:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:33:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 6 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:33:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Flow 'volume_create_manager' (4d43fe16-1ff9-4021-a22e-5421d7d3d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b6e18f-72b1-4dc3-99c7-846cb8e55898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b6e18f-72b1-4dc3-99c7-846cb8e55898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-976704039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ea2da3-df06-4550-be30-70c73fb2915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd725113346b4467948525f04f8665a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:50Z,use_quota=True,user_id='86783e4d49614f0db60e1220f4d29e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc25649-0a37-4d1d-a5b8-ff61d9661203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbc25649-0a37-4d1d-a5b8-ff61d9661203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a39d6b-f0ce-4a2f-97ca-cf091a3f9377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12a39d6b-f0ce-4a2f-97ca-cf091a3f9377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00ea2da3-df06-4550-be30-70c73fb2915d', 'volume_name': 'volume-00ea2da3-df06-4550-be30-70c73fb2915d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12661d-26e1-4837-9baf-a813893d1421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba12661d-26e1-4837-9baf-a813893d1421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6626cd3b-c552-4ded-982b-c1f36313d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Volume 00ea2da3-df06-4550-be30-70c73fb2915d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00ea2da3-df06-4550-be30-70c73fb2915d', 'volume_size': 1}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-976704039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00ea2da3-df06-4550-be30-70c73fb2915d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd725113346b4467948525f04f8665a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:33:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:33:50Z,use_quota=True,user_id='86783e4d49614f0db60e1220f4d29e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Creating volume 00ea2da3-df06-4550-be30-70c73fb2915d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:33:49 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:33:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:49 devstack sudo[88448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d 1073741824
Jul 07 22:33:49 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:51 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d 1073741824" returned: 0 in 1.095s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:33:51 devstack sudo[88770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d
Jul 07 22:33:51 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:33:51 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root
Jul 07 22:33:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:33:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:33:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:33:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6626cd3b-c552-4ded-982b-c1f36313d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00ea2da3-df06-4550-be30-70c73fb2915d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961f289c-36e8-4180-84de-1555a994d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:33:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Volume volume-00ea2da3-df06-4550-be30-70c73fb2915d (00ea2da3-df06-4550-be30-70c73fb2915d): created successfully
Jul 07 22:33:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (961f289c-36e8-4180-84de-1555a994d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:33:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Flow 'volume_create_manager' (4d43fe16-1ff9-4021-a22e-5421d7d3d079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:33:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a63730a2-592b-42e3-a0af-420cd8af95e4 tempest-TaggedAttachmentsTest-1305465000 None] Created volume successfully.
Jul 07 22:34:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:34:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Flow 'volume_create_manager' (dc6ee041-0cb4-4fc4-8065-2035da346570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ae2a96-2a69-40d0-a07e-d9d905ebadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87ae2a96-2a69-40d0-a07e-d9d905ebadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-83086663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a630ce-518d-4765-983c-503d2a672f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1223facc5d484a218ea69216bb346eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:30Z,use_quota=True,user_id='76bd99aa49db49adba6d47109e48ca46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3698d1d-44cb-4556-9b12-d9adb9ab67c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3698d1d-44cb-4556-9b12-d9adb9ab67c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923a17f8-c8f8-489b-8b4f-24fc9ad71dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923a17f8-c8f8-489b-8b4f-24fc9ad71dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a630ce-518d-4765-983c-503d2a672f8b', 'volume_name': 'volume-b9a630ce-518d-4765-983c-503d2a672f8b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dafc4b-3a41-4552-a0f4-a0548d25f07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18dafc4b-3a41-4552-a0f4-a0548d25f07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62ae5e5-a592-4e18-a55b-1fcdaf2e2cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Volume b9a630ce-518d-4765-983c-503d2a672f8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a630ce-518d-4765-983c-503d2a672f8b', 'volume_size': 1}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-83086663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a630ce-518d-4765-983c-503d2a672f8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1223facc5d484a218ea69216bb346eb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:34:30Z,use_quota=True,user_id='76bd99aa49db49adba6d47109e48ca46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Creating volume b9a630ce-518d-4765-983c-503d2a672f8b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:34:30 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:34:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:30 devstack sudo[89204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b 1073741824
Jul 07 22:34:30 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:32 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b 1073741824" returned: 0 in 2.044s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:32 devstack sudo[89210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b
Jul 07 22:34:32 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:33 devstack sudo[89213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:34:33 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:34 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b" returned: 0 in 2.496s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] <== create_volume: return (4673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.680s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a62ae5e5-a592-4e18-a55b-1fcdaf2e2cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a630ce-518d-4765-983c-503d2a672f8b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab4a235-ccd0-4436-9f6f-24e22c441d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:34:34 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Volume volume-b9a630ce-518d-4765-983c-503d2a672f8b (b9a630ce-518d-4765-983c-503d2a672f8b): created successfully
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab4a235-ccd0-4436-9f6f-24e22c441d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:34:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Flow 'volume_create_manager' (dc6ee041-0cb4-4fc4-8065-2035da346570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:34:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a12e0507-ba70-41dc-92b5-32d10a59a390 tempest-VolumesAdminNegativeTest-939069415 None] Created volume successfully.
Jul 07 22:34:37 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 3.382s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 6 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Acquiring lock "cinder-b9a630ce-518d-4765-983c-503d2a672f8b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "cinder-b9a630ce-518d-4765-983c-503d2a672f8b-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Acquiring lock "cinder-quobyte-b9a630ce-518d-4765-983c-503d2a672f8b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:34:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "cinder-quobyte-b9a630ce-518d-4765-983c-503d2a672f8b" acquired by "delete_volume" :: waited 0.063s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:34:38 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpq7ip9d74/privsep.sock']
Jul 07 22:34:38 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpq7ip9d74/privsep.sock
Jul 07 22:34:38 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:34:40 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 07 22:34:42 devstack cinder-volume[88152]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 07 22:34:42 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:42 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Spawned new privsep daemon via rootwrap
Jul 07 22:34:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Accepted privsep connection to /tmp/tmpq7ip9d74/privsep.sock {{(pid=88152) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 07 22:34:42 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 07 22:34:42 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 07 22:34:42 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 07 22:34:42 devstack cinder-volume[88152]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89230
Jul 07 22:34:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bceb846-1221-420f-bf5a-c90cc860b6d1]: (2,) {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d23a281-4c4c-4ad9-8f66-6404b2593d72]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:34:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:43 devstack sudo[89232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b
Jul 07 22:34:43 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:44 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b" returned: 0 in 1.915s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:45 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b
Jul 07 22:34:45 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:46 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b9a630ce-518d-4765-983c-503d2a672f8b" returned: 0 in 1.405s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "cinder-quobyte-b9a630ce-518d-4765-983c-503d2a672f8b" released by "delete_volume" :: held 8.382s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:34:46 devstack cinder-volume[88152]: WARNING cinder.quota [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:46 devstack cinder-volume[88152]: WARNING cinder.quota [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Created reservations ['84d16b8c-a719-4228-98c3-ffc6b84efd8e', 'b6a9bf6c-eb56-4445-8786-58905d63f20c', '222e3372-b164-434f-b850-00a7a99f9677', '50a48ba6-d25a-478d-8bc7-f414b4886b9a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:34:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:34:46 devstack sudo[89277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:34:46 devstack sudo[89277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:34:48 devstack sudo[89277]: pam_unix(sudo:session): session closed for user root
Jul 07 22:34:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.502s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:34:48 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:34:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Deleted volume successfully.
Jul 07 22:34:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2bad55b4-a029-4d7d-8aa9-bee5a7296893 tempest-VolumesAdminNegativeTest-939069415 None] Lock "cinder-b9a630ce-518d-4765-983c-503d2a672f8b-delete_volume" released by "delete_volume" :: held 10.538s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Flow 'volume_create_manager' (21f20cd0-eb75-4b69-903d-284d7d2d40f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59b09a3-0fa4-47d8-8131-f2f1836d01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59b09a3-0fa4-47d8-8131-f2f1836d01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1599927179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753e67eb-7cb7-4633-a08a-d505a5facf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc18004d439a466182c7b63b2a4ffe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:02Z,use_quota=True,user_id='4b8afd1e95294d78bcf4edfafd4bebf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f808f-95a7-4d26-bee6-87e287747cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (116f808f-95a7-4d26-bee6-87e287747cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154a5a96-adbc-45cd-aa35-a14619a0302b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154a5a96-adbc-45cd-aa35-a14619a0302b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753e67eb-7cb7-4633-a08a-d505a5facf31', 'volume_name': 'volume-753e67eb-7cb7-4633-a08a-d505a5facf31', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7794bb51-73fc-44a2-8801-16fc8ad296c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7794bb51-73fc-44a2-8801-16fc8ad296c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d8c6d4-026d-45ce-a78b-6cdc1f3b611c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:01 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Volume 753e67eb-7cb7-4633-a08a-d505a5facf31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753e67eb-7cb7-4633-a08a-d505a5facf31', 'volume_size': 1}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1599927179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753e67eb-7cb7-4633-a08a-d505a5facf31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc18004d439a466182c7b63b2a4ffe77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:02Z,use_quota=True,user_id='4b8afd1e95294d78bcf4edfafd4bebf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Creating volume 753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:01 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:35:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:01 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 1073741824
Jul 07 22:35:01 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:03 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 1073741824" returned: 0 in 1.138s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:03 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31
Jul 07 22:35:03 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:03 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31" returned: 0 in 0.852s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d8c6d4-026d-45ce-a78b-6cdc1f3b611c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753e67eb-7cb7-4633-a08a-d505a5facf31', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09756ff4-a9fd-4d0d-8478-b8a3f525045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Volume volume-753e67eb-7cb7-4633-a08a-d505a5facf31 (753e67eb-7cb7-4633-a08a-d505a5facf31): created successfully
Jul 07 22:35:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09756ff4-a9fd-4d0d-8478-b8a3f525045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Flow 'volume_create_manager' (21f20cd0-eb75-4b69-903d-284d7d2d40f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-051efe7e-7150-485b-aaa4-e925769fa6bf tempest-ServerActionsTestOtherA-414928673 None] Created volume successfully.
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Flow 'volume_create_manager' (dd3f3388-1b6e-4a87-99dc-602bc6845cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2f75b5-1b61-4b2e-bb4b-7145ca2216db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e2f75b5-1b61-4b2e-bb4b-7145ca2216db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2002834278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7261be-ceb0-480b-b18d-32d6453620a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175bec4b80e542e1a4ffe31257825507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:08Z,use_quota=True,user_id='4fe64aeb3a5149f8a579a6123b2d27b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef4e8a7-05cb-448b-8c22-dbd15c5154a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef4e8a7-05cb-448b-8c22-dbd15c5154a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7146e92b-e985-4d51-888d-5c60d0e821c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7146e92b-e985-4d51-888d-5c60d0e821c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7261be-ceb0-480b-b18d-32d6453620a1', 'volume_name': 'volume-4d7261be-ceb0-480b-b18d-32d6453620a1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26af8079-7248-4897-b263-d7e1aaf6e81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26af8079-7248-4897-b263-d7e1aaf6e81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b80cb-868f-4900-88c0-e29f52d63be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:07 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Volume 4d7261be-ceb0-480b-b18d-32d6453620a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7261be-ceb0-480b-b18d-32d6453620a1', 'volume_size': 1}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:35:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2002834278',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7261be-ceb0-480b-b18d-32d6453620a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175bec4b80e542e1a4ffe31257825507',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:35:08Z,use_quota=True,user_id='4fe64aeb3a5149f8a579a6123b2d27b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Creating volume 4d7261be-ceb0-480b-b18d-32d6453620a1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:35:07 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:35:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:07 devstack sudo[89543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 1073741824
Jul 07 22:35:07 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:08 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 1073741824" returned: 0 in 1.061s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:08 devstack sudo[89551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1
Jul 07 22:35:08 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:09 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1" returned: 0 in 0.769s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960b80cb-868f-4900-88c0-e29f52d63be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7261be-ceb0-480b-b18d-32d6453620a1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d66b1ca-3e9f-4368-b411-b87dfba66c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:35:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Volume volume-4d7261be-ceb0-480b-b18d-32d6453620a1 (4d7261be-ceb0-480b-b18d-32d6453620a1): created successfully
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d66b1ca-3e9f-4368-b411-b87dfba66c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:35:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Flow 'volume_create_manager' (dd3f3388-1b6e-4a87-99dc-602bc6845cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:35:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8453b178-c51a-4a79-8429-224e4dec5a74 tempest-DeleteServersTestJSON-1731209196 None] Created volume successfully.
Jul 07 22:35:17 devstack cinder-volume[88152]: WARNING py.warnings [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Jul 07 22:35:17 devstack cinder-volume[88152]:   .first()
Jul 07 22:35:17 devstack cinder-volume[88152]: 
Jul 07 22:35:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4847f1b3-fe0c-4b68-8e24-0003231d9adf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:17 devstack sudo[89626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1
Jul 07 22:35:17 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:18 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1" returned: 0 in 0.958s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.989s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-4d7261be-ceb0-480b-b18d-32d6453620a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb18650e-a3bf-49ab-aa9c-37a2952f5aeb', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:35:18 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-7bd397f4-c304-4dd8-831b-6791edd228d0 req-596f53d1-b3d2-4097-90b5-e4f7f61b5cb0 tempest-DeleteServersTestJSON-1731209196 None] attachment_update completed successfully.
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:INSERT=4,cinder:DELETE=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=19,cinder:SELECT=18,cinder:INSERT=3,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da51d6-5cb5-468d-8492-17ac8b0af5ac]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:28 devstack sudo[90177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d
Jul 07 22:35:28 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:29 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d" returned: 0 in 1.370s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.420s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-00ea2da3-df06-4550-be30-70c73fb2915d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '516234c2-5da4-46d7-b688-95c5a5ab1fd3', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:35:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-fc2a7899-b9f9-432a-b650-35b81af4c548 req-b6edfa97-a0f1-41a1-a33b-2f8a9c9a53f2 tempest-TaggedAttachmentsTest-1305465000 None] attachment_update completed successfully.
Jul 07 22:35:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-4704b760-20c4-4ed5-8b38-6d2c6642e50d req-674ed1b2-0962-40ad-aa72-1c68530f1249 tempest-DeleteServersTestJSON-1731209196 None] Terminate volume connection completed successfully.
Jul 07 22:35:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-4704b760-20c4-4ed5-8b38-6d2c6642e50d req-674ed1b2-0962-40ad-aa72-1c68530f1249 tempest-DeleteServersTestJSON-1731209196 None] Deleting attachment cb18650e-a3bf-49ab-aa9c-37a2952f5aeb. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:33 devstack sudo[90572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:35:33 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:34 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.012s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:35:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 8 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:35:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "cinder-4d7261be-ceb0-480b-b18d-32d6453620a1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "cinder-4d7261be-ceb0-480b-b18d-32d6453620a1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "cinder-quobyte-4d7261be-ceb0-480b-b18d-32d6453620a1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "cinder-quobyte-4d7261be-ceb0-480b-b18d-32d6453620a1" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9935b07-0591-484d-97d4-2118382ddf69]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:36 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1
Jul 07 22:35:36 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:37 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1" returned: 0 in 0.853s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:37 devstack sudo[90622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1
Jul 07 22:35:37 devstack sudo[90622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-266e4c65-6884-4f21-98d9-1da435fcc9fa req-c921805e-194f-40ee-be99-01b3978cac8d tempest-TaggedAttachmentsTest-1305465000 None] Terminate volume connection completed successfully.
Jul 07 22:35:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-266e4c65-6884-4f21-98d9-1da435fcc9fa req-c921805e-194f-40ee-be99-01b3978cac8d tempest-TaggedAttachmentsTest-1305465000 None] Deleting attachment 516234c2-5da4-46d7-b688-95c5a5ab1fd3. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:35:38 devstack sudo[90622]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4d7261be-ceb0-480b-b18d-32d6453620a1" returned: 0 in 0.683s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "cinder-quobyte-4d7261be-ceb0-480b-b18d-32d6453620a1" released by "delete_volume" :: held 1.581s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Created reservations ['2c99c1f6-0907-4530-9305-f50c0cd640bc', '20160502-a103-4f19-802e-8274e83a82c1', 'e024059b-1b96-4196-a57e-8de58283c12d', '9d69df6e-332b-40f3-a152-fdaa5eff4150'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:38 devstack sudo[90652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:35:38 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:39 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:35:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Deleted volume successfully.
Jul 07 22:35:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-70bbb68a-3199-4098-9bbc-f35156b9c704 tempest-DeleteServersTestJSON-1731209196 None] Lock "cinder-4d7261be-ceb0-480b-b18d-32d6453620a1-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:35:48 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:49 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:35:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:35:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:35:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[556e0edb-3df8-4da2-9c1e-9481140c0a0c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:53 devstack sudo[90858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31
Jul 07 22:35:53 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:35:55 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root
Jul 07 22:35:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31" returned: 0 in 1.404s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:35:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.434s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:35:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-753e67eb-7cb7-4633-a08a-d505a5facf31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '372ae149-0995-44a7-8dd1-f99d4ee9e459', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:35:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-90c98d6d-a251-4693-a26d-56cda87b7123 req-2f1bb06d-54ab-4bde-a723-31d8f436dbf6 tempest-ServerActionsTestOtherA-414928673 None] attachment_update completed successfully.
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "cinder-00ea2da3-df06-4550-be30-70c73fb2915d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "cinder-00ea2da3-df06-4550-be30-70c73fb2915d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "cinder-quobyte-00ea2da3-df06-4550-be30-70c73fb2915d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "cinder-quobyte-00ea2da3-df06-4550-be30-70c73fb2915d" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a15bf12-548b-4a4c-9614-b8e2a9cc1978]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:35:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:35:58 devstack sudo[91281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d
Jul 07 22:35:58 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:00 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d" returned: 0 in 1.250s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:00 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d
Jul 07 22:36:00 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:00 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-00ea2da3-df06-4550-be30-70c73fb2915d" returned: 0 in 0.823s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "cinder-quobyte-00ea2da3-df06-4550-be30-70c73fb2915d" released by "delete_volume" :: held 2.134s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:00 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Created reservations ['cb34c708-924f-45d9-846c-580e879637f6', '069dd208-4616-4e24-84e4-2860217a463e', '2dd2b87b-14c3-4276-a41e-625cfe2f20d5', '3a968988-c9fd-4f3f-b05b-41b778bf8189'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:01 devstack sudo[91289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:36:01 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:02 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.002s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:02 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Deleted volume successfully.
Jul 07 22:36:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89b482c3-d210-4532-8cd7-ee5ae6f3edf4 tempest-TaggedAttachmentsTest-1305465000 None] Lock "cinder-00ea2da3-df06-4550-be30-70c73fb2915d-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-28c3d75e-1356-4c6a-a415-5a21ddf3efba tempest-ServerActionsTestOtherA-414928673 None] Terminate volume connection completed successfully.
Jul 07 22:36:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-28c3d75e-1356-4c6a-a415-5a21ddf3efba tempest-ServerActionsTestOtherA-414928673 None] Deleting attachment 372ae149-0995-44a7-8dd1-f99d4ee9e459. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:36:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8a2435-b48d-4b98-823d-a6891cf0e34c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:08 devstack sudo[91404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31
Jul 07 22:36:08 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:09 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31" returned: 0 in 1.188s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.218s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-753e67eb-7cb7-4633-a08a-d505a5facf31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ffe2459-29a8-4405-b291-2f5355b4aa63', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:36:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-863458f6-48c4-47c0-bc83-f7e6aa3af69a req-459bc003-fbb0-41a8-a446-bd957607ff31 tempest-ServerActionsTestOtherA-414928673 None] attachment_update completed successfully.
Jul 07 22:36:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:36:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=15,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Flow 'volume_create_manager' (dca00eb6-9162-45cd-8b07-879d9a015ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa952d-3e12-49f5-afd4-77ae0833fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cfa952d-3e12-49f5-afd4-77ae0833fc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-295479110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cad9fca-8a64-4d98-90a0-7c032cdf0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c497757eb849938f1c418f63c50c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:31Z,use_quota=True,user_id='420a4e06053b47baa6186322884eabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549b689-8182-4bd5-9c2e-e51d3d860b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c549b689-8182-4bd5-9c2e-e51d3d860b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b1e4bd-1a91-4b11-b6e8-ac3b7115f203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3b1e4bd-1a91-4b11-b6e8-ac3b7115f203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cad9fca-8a64-4d98-90a0-7c032cdf0ce3', 'volume_name': 'volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0f9724-9baa-4c5a-b73d-214f590f48b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a0f9724-9baa-4c5a-b73d-214f590f48b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9178c4c9-05d3-4d63-a7d7-a460f6006bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:31 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Volume 5cad9fca-8a64-4d98-90a0-7c032cdf0ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3', 'volume_size': 1}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-295479110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cad9fca-8a64-4d98-90a0-7c032cdf0ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c497757eb849938f1c418f63c50c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:31Z,use_quota=True,user_id='420a4e06053b47baa6186322884eabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Creating volume 5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:31 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:36:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:31 devstack sudo[92086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 1073741824
Jul 07 22:36:31 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:33 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 1073741824" returned: 0 in 1.801s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:33 devstack sudo[92116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3
Jul 07 22:36:33 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:33 devstack sudo[92119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:36:33 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:34 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" returned: 0 in 1.373s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] <== create_volume: return (3273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.283s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9178c4c9-05d3-4d63-a7d7-a460f6006bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:34 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834cdad6-e33f-44be-a7d2-4190a91ec863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.171s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:35 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Volume volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 (5cad9fca-8a64-4d98-90a0-7c032cdf0ce3): created successfully
Jul 07 22:36:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834cdad6-e33f-44be-a7d2-4190a91ec863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Flow 'volume_create_manager' (dca00eb6-9162-45cd-8b07-879d9a015ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cbd6aba6-6239-497c-b0c6-b2eb752241d1 tempest-ServersNegativeTestJSON-248572772 None] Created volume successfully.
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Flow 'volume_create_manager' (0034a0c5-9621-46d2-81f1-6c1865b1af25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe975fc-7612-49c2-a388-96fcc169b0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe975fc-7612-49c2-a388-96fcc169b0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1363793967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb77e74f-f956-4e12-9526-828be6c939d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c497757eb849938f1c418f63c50c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:39Z,use_quota=True,user_id='420a4e06053b47baa6186322884eabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da151449-16a3-42f6-9d8e-affe527556e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da151449-16a3-42f6-9d8e-affe527556e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7894afb0-03c6-44d0-a154-a983f4d30bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7894afb0-03c6-44d0-a154-a983f4d30bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb77e74f-f956-4e12-9526-828be6c939d7', 'volume_name': 'volume-eb77e74f-f956-4e12-9526-828be6c939d7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b3baa8-3572-4cc6-bae8-0bf64b0ae453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b3baa8-3572-4cc6-bae8-0bf64b0ae453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375f1482-1f15-4769-9490-bce48b4515c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Volume eb77e74f-f956-4e12-9526-828be6c939d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb77e74f-f956-4e12-9526-828be6c939d7', 'volume_size': 1}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1363793967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb77e74f-f956-4e12-9526-828be6c939d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78c497757eb849938f1c418f63c50c12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:39Z,use_quota=True,user_id='420a4e06053b47baa6186322884eabd9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Creating volume eb77e74f-f956-4e12-9526-828be6c939d7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:38 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:36:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:38 devstack sudo[92162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 1073741824
Jul 07 22:36:38 devstack sudo[92162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:39 devstack sudo[92162]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 1073741824" returned: 0 in 0.989s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:39 devstack sudo[92172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7
Jul 07 22:36:39 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:40 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7" returned: 0 in 0.721s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375f1482-1f15-4769-9490-bce48b4515c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb77e74f-f956-4e12-9526-828be6c939d7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73004db5-d73d-4611-bbde-e54fc7514276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Volume volume-eb77e74f-f956-4e12-9526-828be6c939d7 (eb77e74f-f956-4e12-9526-828be6c939d7): created successfully
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73004db5-d73d-4611-bbde-e54fc7514276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Flow 'volume_create_manager' (0034a0c5-9621-46d2-81f1-6c1865b1af25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a48762c4-5be3-4f41-b9ca-84fecb2f99d1 tempest-ServersNegativeTestJSON-248572772 None] Created volume successfully.
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "cinder-eb77e74f-f956-4e12-9526-828be6c939d7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-eb77e74f-f956-4e12-9526-828be6c939d7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "cinder-quobyte-eb77e74f-f956-4e12-9526-828be6c939d7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-quobyte-eb77e74f-f956-4e12-9526-828be6c939d7" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[039600da-8166-4479-ae5e-d8f6abe565b6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:41 devstack sudo[92178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7
Jul 07 22:36:41 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:42 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7" returned: 0 in 0.880s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:42 devstack sudo[92185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7
Jul 07 22:36:42 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:43 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-eb77e74f-f956-4e12-9526-828be6c939d7" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-quobyte-eb77e74f-f956-4e12-9526-828be6c939d7" released by "delete_volume" :: held 1.648s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Created reservations ['cecd94b1-6bce-4fe4-b435-a91d402a8611', '386b2d4a-64fb-4b8f-9053-9d56f8d46ef4', '32270b0b-6d88-4b9c-938f-264ba1468bd7', 'a7d3c731-9a04-4a67-a9bc-5e40efa8075b'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:43 devstack sudo[92188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:36:43 devstack sudo[92188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "cinder-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "cinder-quobyte-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-quobyte-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" acquired by "delete_volume" :: waited 0.086s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06735d3-b159-4bae-a2e6-d35ad0f83a42]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:44 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3
Jul 07 22:36:44 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:44 devstack sudo[92188]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.365s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Deleted volume successfully.
Jul 07 22:36:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-79a43ccb-622b-4905-af95-068b3f0efe35 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-eb77e74f-f956-4e12-9526-828be6c939d7-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:45 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" returned: 0 in 1.414s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:45 devstack sudo[92263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3
Jul 07 22:36:45 devstack sudo[92263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:46 devstack sudo[92263]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" returned: 0 in 1.172s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-quobyte-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3" released by "delete_volume" :: held 2.664s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Created reservations ['ed1a847f-518d-4e22-8bb0-1c5e52ed767c', '919fe971-f2f0-4da5-ab88-5bb692a1bb93', '5517d80e-0c60-4fce-bcba-bb86c26a5e2c', 'cb9ecf82-4fe1-4fba-a2c1-5b1e6a95dc6f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:46 devstack sudo[92267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:36:46 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:47 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.893s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:47 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:36:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Deleted volume successfully.
Jul 07 22:36:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d745f976-20a0-4d08-9d84-4149029e2870 tempest-ServersNegativeTestJSON-248572772 None] Lock "cinder-5cad9fca-8a64-4d98-90a0-7c032cdf0ce3-delete_volume" released by "delete_volume" :: held 4.144s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Flow 'volume_create_manager' (4b72f75a-bf22-4460-9dc9-cee0d2a44ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623fec3-a6e7-47e8-aaf4-9b145e823494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f623fec3-a6e7-47e8-aaf4-9b145e823494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-353918831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acee023e-ce7a-42c3-9083-7ae17d50ecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c415f0545f043abac2979c272f09710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:48Z,use_quota=True,user_id='373b92aaff544b6fab1ce0f74da56444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e816a7-5bff-4b3a-9ace-9d432a6fd169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e816a7-5bff-4b3a-9ace-9d432a6fd169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f38be0-e60e-450e-abd8-215ace2dedf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78f38be0-e60e-450e-abd8-215ace2dedf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acee023e-ce7a-42c3-9083-7ae17d50ecd9', 'volume_name': 'volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d2465f-4a55-4fd7-8819-31b1634a4d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44d2465f-4a55-4fd7-8819-31b1634a4d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196c0592-53d9-4028-9548-e5b918d1d251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Volume acee023e-ce7a-42c3-9083-7ae17d50ecd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9', 'volume_size': 1}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-353918831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acee023e-ce7a-42c3-9083-7ae17d50ecd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c415f0545f043abac2979c272f09710',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:36:48Z,use_quota=True,user_id='373b92aaff544b6fab1ce0f74da56444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Creating volume acee023e-ce7a-42c3-9083-7ae17d50ecd9 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:36:48 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:36:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:48 devstack sudo[92271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 1073741824
Jul 07 22:36:48 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:49 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 1073741824" returned: 0 in 1.228s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:36:49 devstack sudo[92326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9
Jul 07 22:36:49 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:36:50 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root
Jul 07 22:36:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9" returned: 0 in 1.124s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:36:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:36:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:36:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196c0592-53d9-4028-9548-e5b918d1d251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7ace42-5637-4ae9-8a1c-6e34c18cfc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:36:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Volume volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 (acee023e-ce7a-42c3-9083-7ae17d50ecd9): created successfully
Jul 07 22:36:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b7ace42-5637-4ae9-8a1c-6e34c18cfc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:36:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Flow 'volume_create_manager' (4b72f75a-bf22-4460-9dc9-cee0d2a44ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:36:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e8dc207b-7c01-43c7-81f2-483104923820 tempest-ServerRescueNegativeTestJSON-901860562 None] Created volume successfully.
Jul 07 22:37:01 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=6 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:37:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-88dff51a-c494-4c1e-976b-2c79da40b53d req-e5957080-3dcc-4e8a-be1a-2462dd3b2bf6 tempest-ServerActionsTestOtherA-414928673 None] Terminate volume connection completed successfully.
Jul 07 22:37:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-88dff51a-c494-4c1e-976b-2c79da40b53d req-e5957080-3dcc-4e8a-be1a-2462dd3b2bf6 tempest-ServerActionsTestOtherA-414928673 None] Deleting attachment 7ffe2459-29a8-4405-b291-2f5355b4aa63. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Flow 'volume_create_manager' (a082d902-0a42-4a38-b39a-a69b138b4d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ddbfda-233f-4573-ab8c-9fdf6401f0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ddbfda-233f-4573-ab8c-9fdf6401f0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-498473737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b93632-4199-4cee-b67a-d52826e1f8df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef8a39502b47138fb9d93ddb931623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:07Z,use_quota=True,user_id='8fc8abb5dda24d7f81b150818e9a6119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd7dfa2-b03d-43db-8199-65e9cf8dff4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd7dfa2-b03d-43db-8199-65e9cf8dff4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff86cb-2531-4992-906f-05d4fdcbe6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff86cb-2531-4992-906f-05d4fdcbe6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b93632-4199-4cee-b67a-d52826e1f8df', 'volume_name': 'volume-a0b93632-4199-4cee-b67a-d52826e1f8df', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aad94b-a633-459d-90ff-a938d6badbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45aad94b-a633-459d-90ff-a938d6badbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962c14a2-d07f-4473-b0aa-83be0449f5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:07 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Volume a0b93632-4199-4cee-b67a-d52826e1f8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b93632-4199-4cee-b67a-d52826e1f8df', 'volume_size': 1}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-498473737',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b93632-4199-4cee-b67a-d52826e1f8df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f4ef8a39502b47138fb9d93ddb931623',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:07Z,use_quota=True,user_id='8fc8abb5dda24d7f81b150818e9a6119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Creating volume a0b93632-4199-4cee-b67a-d52826e1f8df {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:07 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:07 devstack sudo[92528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df 1073741824
Jul 07 22:37:07 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:09 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df 1073741824" returned: 0 in 1.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:09 devstack sudo[92590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df
Jul 07 22:37:09 devstack sudo[92590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:10 devstack sudo[92590]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df" returned: 0 in 1.102s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] <== create_volume: return (3029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.033s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962c14a2-d07f-4473-b0aa-83be0449f5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b93632-4199-4cee-b67a-d52826e1f8df', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cac72b-eeb3-4357-af36-d593ba3addc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Volume volume-a0b93632-4199-4cee-b67a-d52826e1f8df (a0b93632-4199-4cee-b67a-d52826e1f8df): created successfully
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9cac72b-eeb3-4357-af36-d593ba3addc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Flow 'volume_create_manager' (a082d902-0a42-4a38-b39a-a69b138b4d30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:10 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-3c246b12-ff77-45bd-83d6-0e140ccdca3a req-e36d08a5-2459-4e63-9d43-fc55e9147c99 tempest-VolumesGetTestJSON-1478616488 None] Created volume successfully.
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Acquiring lock "cinder-a0b93632-4199-4cee-b67a-d52826e1f8df-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "cinder-a0b93632-4199-4cee-b67a-d52826e1f8df-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Acquiring lock "cinder-quobyte-a0b93632-4199-4cee-b67a-d52826e1f8df" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "cinder-quobyte-a0b93632-4199-4cee-b67a-d52826e1f8df" acquired by "delete_volume" :: waited 0.037s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Acquiring lock "cinder-acee023e-ce7a-42c3-9083-7ae17d50ecd9-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1035881-f55d-4c2f-bc5c-86cb5ee644a3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "cinder-acee023e-ce7a-42c3-9083-7ae17d50ecd9-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Acquiring lock "cinder-quobyte-acee023e-ce7a-42c3-9083-7ae17d50ecd9" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "cinder-quobyte-acee023e-ce7a-42c3-9083-7ae17d50ecd9" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04c3abb-040e-41ed-94b5-6f045eec3aa7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:12 devstack sudo[92608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df
Jul 07 22:37:12 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:12 devstack sudo[92609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9
Jul 07 22:37:12 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:14 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9" returned: 0 in 1.452s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:14 devstack sudo[92623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9
Jul 07 22:37:14 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:14 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df" returned: 0 in 1.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:14 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df
Jul 07 22:37:14 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:15 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-acee023e-ce7a-42c3-9083-7ae17d50ecd9" returned: 0 in 1.260s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "cinder-quobyte-acee023e-ce7a-42c3-9083-7ae17d50ecd9" released by "delete_volume" :: held 2.832s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:15 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a0b93632-4199-4cee-b67a-d52826e1f8df" returned: 0 in 1.242s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "cinder-quobyte-a0b93632-4199-4cee-b67a-d52826e1f8df" released by "delete_volume" :: held 3.082s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Created reservations ['9af6a2ff-ae1e-42dd-bc51-e69c34067526', 'd4fb032b-1515-4ac9-b47f-e43492607748', '8d3b6f72-d9f7-4deb-9175-a1d388c2606f', '9f9bb4f1-f0ef-4176-b225-28953047b0ab'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:15 devstack sudo[92631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:37:15 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:15 devstack cinder-volume[88152]: DEBUG cinder.quota [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Created reservations ['0a051db0-5835-4c73-8698-5aafc82fcab4', 'c78c7477-7c12-4d48-9e1b-be3185f52d03', '65038d65-3e0c-4569-9717-df13981c7e5b', '4d386a77-1a11-438d-8ef0-5890e023fdf1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:16 devstack sudo[92633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:37:16 devstack sudo[92633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "cinder-753e67eb-7cb7-4633-a08a-d505a5facf31-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "cinder-753e67eb-7cb7-4633-a08a-d505a5facf31-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:17 devstack sudo[92633]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.279s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.manager [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Deleted volume successfully.
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "cinder-quobyte-753e67eb-7cb7-4633-a08a-d505a5facf31" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "cinder-quobyte-753e67eb-7cb7-4633-a08a-d505a5facf31" acquired by "delete_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-613a123e-9608-416c-b49f-8ebbd1fbb41b req-8bd6d4b9-1205-4744-9584-f6865acebdb2 tempest-VolumesGetTestJSON-1478616488 None] Lock "cinder-a0b93632-4199-4cee-b67a-d52826e1f8df-delete_volume" released by "delete_volume" :: held 5.166s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca4b4ba-76fe-4340-93d2-bc3ad014b4b9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:17 devstack sudo[92638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31
Jul 07 22:37:17 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:17 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.153s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Deleted volume successfully.
Jul 07 22:37:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-300f4296-79a0-45cc-9703-5517f3916ccc tempest-ServerRescueNegativeTestJSON-901860562 None] Lock "cinder-acee023e-ce7a-42c3-9083-7ae17d50ecd9-delete_volume" released by "delete_volume" :: held 5.460s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:19 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31" returned: 0 in 1.988s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:19 devstack sudo[92670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31
Jul 07 22:37:19 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:21 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-753e67eb-7cb7-4633-a08a-d505a5facf31" returned: 0 in 1.610s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "cinder-quobyte-753e67eb-7cb7-4633-a08a-d505a5facf31" released by "delete_volume" :: held 3.712s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Created reservations ['89436ffe-8002-455e-b34d-279aacce676f', 'a8d944a2-14e6-43d4-910c-00b189d4f972', 'c35ed953-2fb9-4ac4-afb4-a8e0423f2220', 'fbddb751-5eba-4de8-b6ab-8fd125f0f1a5'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:21 devstack sudo[92675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:37:21 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:22 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.190s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:22 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Deleted volume successfully.
Jul 07 22:37:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6d20f9f9-2cd7-4694-a198-5749c435b1ee tempest-ServerActionsTestOtherA-414928673 None] Lock "cinder-753e67eb-7cb7-4633-a08a-d505a5facf31-delete_volume" released by "delete_volume" :: held 5.398s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:31 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:37:32 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=17,cinder:UPDATE=31,cinder:INSERT=5,cinder:DELETE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Flow 'volume_create_manager' (b86136f0-27f5-4568-87f4-e944499160c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c32a46e-08c1-416c-a842-0a555003d550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c32a46e-08c1-416c-a842-0a555003d550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1321792096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16f4afe-8f83-46f9-88d7-0f4f5d03544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6de574bb49249cc984e239720833e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:34Z,use_quota=True,user_id='8719556d94924143a94f7161baf5b6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45da3419-f3ed-4b8a-88ae-08e3dae9f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45da3419-f3ed-4b8a-88ae-08e3dae9f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd14769-bfde-4aa3-a360-b6e13e53f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack sudo[92775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:37:33 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd14769-bfde-4aa3-a360-b6e13e53f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16f4afe-8f83-46f9-88d7-0f4f5d03544a', 'volume_name': 'volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b696bce-7426-4d72-bda5-43e117aee8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b696bce-7426-4d72-bda5-43e117aee8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb615e9-bed7-41eb-81bf-fc829e04b639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:33 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a', 'volume_size': 1}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1321792096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16f4afe-8f83-46f9-88d7-0f4f5d03544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6de574bb49249cc984e239720833e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:34Z,use_quota=True,user_id='8719556d94924143a94f7161baf5b6d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Creating volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:33 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:34 devstack sudo[92778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a 1073741824
Jul 07 22:37:34 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Flow 'volume_create_manager' (77ce9944-77fc-4c08-a1ab-0efe27e0e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6c7a4-40a8-4f26-abc8-8d1d3b0e3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a6c7a4-40a8-4f26-abc8-8d1d3b0e3a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387096995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2e121b-8293-42b6-a336-11b89abda1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9297e221a31441ab07a325590be9929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:35Z,use_quota=True,user_id='8db323861827486a88081a63288501f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b151542-f09c-46d2-9762-5e9ee5dd37e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b151542-f09c-46d2-9762-5e9ee5dd37e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd47ce87-e851-4b06-8504-db413bad64bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd47ce87-e851-4b06-8504-db413bad64bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2e121b-8293-42b6-a336-11b89abda1a4', 'volume_name': 'volume-0c2e121b-8293-42b6-a336-11b89abda1a4', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201085e6-3c78-41f7-85c4-d62f68bbedd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201085e6-3c78-41f7-85c4-d62f68bbedd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baaeb5d-f3d8-4577-a2b3-966b501db8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:34 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Volume 0c2e121b-8293-42b6-a336-11b89abda1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2e121b-8293-42b6-a336-11b89abda1a4', 'volume_size': 1}
Jul 07 22:37:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:35 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.240s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 8 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:37:35 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a 1073741824" returned: 0 in 1.193s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:35 devstack sudo[92788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a
Jul 07 22:37:35 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:36 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" returned: 0 in 0.931s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1387096995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2e121b-8293-42b6-a336-11b89abda1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9297e221a31441ab07a325590be9929',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:35Z,use_quota=True,user_id='8db323861827486a88081a63288501f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Creating volume 0c2e121b-8293-42b6-a336-11b89abda1a4 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:36 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:36 devstack sudo[92791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 1073741824
Jul 07 22:37:36 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beb615e9-bed7-41eb-81bf-fc829e04b639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348712cc-d668-409d-9e35-b3a41b3c6899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:36 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Volume volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a (b16f4afe-8f83-46f9-88d7-0f4f5d03544a): created successfully
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (348712cc-d668-409d-9e35-b3a41b3c6899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Flow 'volume_create_manager' (b86136f0-27f5-4568-87f4-e944499160c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-acb7b807-af11-43d9-a60f-2b450d0dcb72 tempest-SnapshotsActionsTest-52495871 None] Created volume successfully.
Jul 07 22:37:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:37 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 1073741824" returned: 0 in 1.241s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:37 devstack sudo[92805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4
Jul 07 22:37:37 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:38 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4" returned: 0 in 0.816s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] <== create_volume: return (2126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.133s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.986s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Creating offline snapshot 6a05000d-6b9c-4804-9774-7eacd89e616c of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2baaeb5d-f3d8-4577-a2b3-966b501db8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2e121b-8293-42b6-a336-11b89abda1a4', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda3e3c4-ba3a-40d9-bed5-157d78b2e60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ee47da-0759-4b9a-831f-1a4161eab0a8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Volume volume-0c2e121b-8293-42b6-a336-11b89abda1a4 (0c2e121b-8293-42b6-a336-11b89abda1a4): created successfully
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda3e3c4-ba3a-40d9-bed5-157d78b2e60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Flow 'volume_create_manager' (77ce9944-77fc-4c08-a1ab-0efe27e0e95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-886c0094-1991-41d2-ae20-cdc0cc284000 tempest-AttachVolumeShelveTestJSON-25861693 None] Created volume successfully.
Jul 07 22:37:38 devstack sudo[92808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a
Jul 07 22:37:38 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:39 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" returned: 0 in 1.039s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:39 devstack sudo[92817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c 1G
Jul 07 22:37:39 devstack sudo[92817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:40 devstack sudo[92817]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c 1G" returned: 0 in 0.910s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:40 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:37:40 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:41 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.889s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:41 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c is being set with open permissions: ugo+rw
Jul 07 22:37:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:41 devstack sudo[92830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:37:41 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:41 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.768s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:42 devstack sudo[92833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info
Jul 07 22:37:42 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (383a9e4e-86e6-4d47-884b-0f7d03c3b113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18379ee-14b8-413b-ac9b-d014cf623a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18379ee-14b8-413b-ac9b-d014cf623a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1938573218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e48ba24-3a98-4626-a38b-f22934a635a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:42Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac6834f-0d96-4bbc-87b5-68b5ab55e4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac6834f-0d96-4bbc-87b5-68b5ab55e4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b40b11-5545-42cb-b119-21443b8bcf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37b40b11-5545-42cb-b119-21443b8bcf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e48ba24-3a98-4626-a38b-f22934a635a7', 'volume_name': 'volume-1e48ba24-3a98-4626-a38b-f22934a635a7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2627383-e1d3-4f30-a494-0c91a98c669a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2627383-e1d3-4f30-a494-0c91a98c669a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0378856-f8ec-4660-98ac-f96281122161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:42 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Volume 1e48ba24-3a98-4626-a38b-f22934a635a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e48ba24-3a98-4626-a38b-f22934a635a7', 'volume_size': 1}
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:42 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info" returned: 0 in 0.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:42 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info is being set with open permissions: ugo+rw
Jul 07 22:37:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:42 devstack sudo[92841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info
Jul 07 22:37:42 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:43 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.info" returned: 0 in 0.713s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.319s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.181s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1938573218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e48ba24-3a98-4626-a38b-f22934a635a7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:42Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Creating volume 1e48ba24-3a98-4626-a38b-f22934a635a7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:43 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:43 devstack sudo[92844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 1073741824
Jul 07 22:37:43 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bab79480-cec8-46d9-8340-6e65f695bcb4 tempest-SnapshotsActionsTest-52495871 None] Create snapshot completed successfully
Jul 07 22:37:44 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 1073741824" returned: 0 in 0.983s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:44 devstack sudo[92856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7
Jul 07 22:37:44 devstack sudo[92856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:45 devstack sudo[92856]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7" returned: 0 in 0.915s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.039s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Creating offline snapshot 6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0378856-f8ec-4660-98ac-f96281122161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e48ba24-3a98-4626-a38b-f22934a635a7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b56da5-4c97-419a-9723-e9215e8d5634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac203c48-00d4-4525-87e3-30d1a4a441b7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:45 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Volume volume-1e48ba24-3a98-4626-a38b-f22934a635a7 (1e48ba24-3a98-4626-a38b-f22934a635a7): created successfully
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b56da5-4c97-419a-9723-e9215e8d5634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (383a9e4e-86e6-4d47-884b-0f7d03c3b113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6f999a33-6791-4747-aaa6-e46e233f5a5e tempest-VolumesTestJSON-1384381727 None] Created volume successfully.
Jul 07 22:37:45 devstack sudo[92860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:37:45 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:46 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 1.250s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:47 devstack sudo[92865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd 1G
Jul 07 22:37:47 devstack sudo[92865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (e001efe4-e168-4c0f-815c-0513c96cace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe33a5d-450c-4435-bcea-c3e4e26cbcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe33a5d-450c-4435-bcea-c3e4e26cbcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133381074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d266243e-7f41-4a42-91f2-2885d84ea929,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:47Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0c7a61-c40c-4bb4-9497-4f3208258fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0c7a61-c40c-4bb4-9497-4f3208258fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1a3d7-dbec-447b-a5e5-5d2e4cc38a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86a1a3d7-dbec-447b-a5e5-5d2e4cc38a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd266243e-7f41-4a42-91f2-2885d84ea929', 'volume_name': 'volume-d266243e-7f41-4a42-91f2-2885d84ea929', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4c641e-a207-409f-b6c1-ab525122e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d4c641e-a207-409f-b6c1-ab525122e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ec37f9-7e33-48c9-ada9-6319879aede9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:47 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Volume d266243e-7f41-4a42-91f2-2885d84ea929: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d266243e-7f41-4a42-91f2-2885d84ea929', 'volume_size': 1}
Jul 07 22:37:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:48 devstack sudo[92865]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd 1G" returned: 0 in 1.161s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:48 devstack sudo[92871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd
Jul 07 22:37:48 devstack sudo[92871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:49 devstack sudo[92871]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" returned: 0 in 1.209s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:49 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd is being set with open permissions: ugo+rw
Jul 07 22:37:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:49 devstack sudo[92876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd
Jul 07 22:37:49 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:50 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" returned: 0 in 0.823s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.584s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1133381074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d266243e-7f41-4a42-91f2-2885d84ea929,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:47Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Creating volume d266243e-7f41-4a42-91f2-2885d84ea929 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:50 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:50 devstack sudo[92879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 1073741824
Jul 07 22:37:50 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6bea0080-bd03-4457-951a-1ed172187536 tempest-SnapshotsActionsTest-52495871 None] Create snapshot completed successfully
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Deleting offline snapshot 6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] snapshot_file for this snap is: volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b57c7b-e8a3-46c8-bc8b-5ae103adef44]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:51 devstack sudo[92921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd
Jul 07 22:37:51 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:51 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 1073741824" returned: 0 in 1.372s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:51 devstack sudo[92926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929
Jul 07 22:37:51 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:52 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" returned: 0 in 1.315s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca7c4c-67aa-488f-a290-d0a7156ab258]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:52 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929" returned: 0 in 0.967s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] <== create_volume: return (2450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:52 devstack sudo[92940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:37:52 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ec37f9-7e33-48c9-ada9-6319879aede9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d266243e-7f41-4a42-91f2-2885d84ea929', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcff9fd4-b70c-4947-b5fe-a063bbd05ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Volume volume-d266243e-7f41-4a42-91f2-2885d84ea929 (d266243e-7f41-4a42-91f2-2885d84ea929): created successfully
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcff9fd4-b70c-4947-b5fe-a063bbd05ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (e001efe4-e168-4c0f-815c-0513c96cace4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-30e86207-6f8c-4c9c-a853-07ee20248bc2 tempest-VolumesTestJSON-1384381727 None] Created volume successfully.
Jul 07 22:37:53 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 1.096s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:53 devstack sudo[92946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd
Jul 07 22:37:53 devstack sudo[92946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:37:54 devstack sudo[92946]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (28e88450-7803-4dd5-93c4-576e2ad23044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361fcd37-2127-46bf-997f-763efc3e7cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" returned: 0 in 1.117s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:54 devstack sudo[92962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd
Jul 07 22:37:54 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (361fcd37-2127-46bf-997f-763efc3e7cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1411465994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4db453-5679-4ce9-adf1-64ba4ea10391,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:55Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21cd9f6-ad60-491a-8d54-80fd0a587ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21cd9f6-ad60-491a-8d54-80fd0a587ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a367930-7d53-46c8-bcbc-263a21cdbf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a367930-7d53-46c8-bcbc-263a21cdbf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4db453-5679-4ce9-adf1-64ba4ea10391', 'volume_name': 'volume-fc4db453-5679-4ce9-adf1-64ba4ea10391', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a045e095-0b00-4a66-9dff-7d2913e6dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a045e095-0b00-4a66-9dff-7d2913e6dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f25548f-5fa8-4d07-a1cd-957723ed3f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Volume fc4db453-5679-4ce9-adf1-64ba4ea10391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4db453-5679-4ce9-adf1-64ba4ea10391', 'volume_size': 1}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1411465994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4db453-5679-4ce9-adf1-64ba4ea10391,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='28e6d63535df4fad853111073aad2cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:37:55Z,use_quota=True,user_id='2fe2e3109c2e4dd6b2483591b12d3362',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Creating volume fc4db453-5679-4ce9-adf1-64ba4ea10391 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:37:54 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:37:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:54 devstack sudo[92965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 1073741824
Jul 07 22:37:54 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:55 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" returned: 0 in 0.874s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd" released by "_delete_snapshot" :: held 4.521s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_snapshot" :: held 4.550s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:55 devstack cinder-volume[88152]: WARNING cinder.quota [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Created reservations ['7687559e-e209-4fd2-b598-7886c2f528b9', '55750baf-e2f0-412e-918e-6ddbb9e81d09', 'c7033712-6532-4976-9952-29038f2403a6', 'e587afdb-fe7e-4a3d-bfb3-428299f5e50e'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:37:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Delete snapshot completed successfully.
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fcfdda1a-8413-4cc8-a779-0796cf4ffd41 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-6fcfd53c-7771-4b6d-b590-e5bc1f69b1dd-delete_snapshot" released by "delete_snapshot" :: held 4.728s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:37:55 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 1073741824" returned: 0 in 1.110s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:56 devstack sudo[92984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391
Jul 07 22:37:56 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:56 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391" returned: 0 in 0.965s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] <== create_volume: return (2148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f25548f-5fa8-4d07-a1cd-957723ed3f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4db453-5679-4ce9-adf1-64ba4ea10391', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1df7947-2611-49e4-b0b7-c6050590274e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:37:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Volume volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 (fc4db453-5679-4ce9-adf1-64ba4ea10391): created successfully
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1df7947-2611-49e4-b0b7-c6050590274e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Flow 'volume_create_manager' (28e88450-7803-4dd5-93c4-576e2ad23044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Creating offline snapshot 533050c7-b840-4782-a8ae-2e47523d74a9 of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:37:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6e5afc7d-e506-4cab-9162-5ea8fc3d503a tempest-VolumesTestJSON-1384381727 None] Created volume successfully.
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abfde8b-ca3b-4183-aa6e-1af93343bd94]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:57 devstack sudo[92990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:37:57 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-2b3d94d3-351a-4523-959e-a08595eaa950 req-e4aa1973-6747-4f15-b0e8-4bb32be435e4 tempest-AttachVolumeShelveTestJSON-25861693 None] No connector for attachment d1357bb8-cca1-4796-bbb6-ffe151e38e84; skipping storage backend terminate_connection call. {{(pid=88152) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 07 22:37:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-2b3d94d3-351a-4523-959e-a08595eaa950 req-e4aa1973-6747-4f15-b0e8-4bb32be435e4 tempest-AttachVolumeShelveTestJSON-25861693 None] Deleting attachment d1357bb8-cca1-4796-bbb6-ffe151e38e84. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:37:58 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.945s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:37:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:58 devstack sudo[92998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 1G
Jul 07 22:37:58 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:59 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 1G" returned: 0 in 1.126s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:59 devstack sudo[93007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9
Jul 07 22:37:59 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-fc4db453-5679-4ce9-adf1-64ba4ea10391-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "cinder-fc4db453-5679-4ce9-adf1-64ba4ea10391-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-quobyte-fc4db453-5679-4ce9-adf1-64ba4ea10391" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-fc4db453-5679-4ce9-adf1-64ba4ea10391" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c07ed7-86eb-42e5-a4d6-8cbdaad43ac4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:37:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:37:59 devstack sudo[93011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391
Jul 07 22:37:59 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:00 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9" returned: 0 in 0.903s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:00 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 is being set with open permissions: ugo+rw
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:00 devstack sudo[93017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9
Jul 07 22:38:00 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:00 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:00 devstack sudo[93022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391
Jul 07 22:38:00 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:00 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.821s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-76f64b11-9577-472c-a668-29efcd7f197a tempest-SnapshotsActionsTest-52495871 None] Create snapshot completed successfully
Jul 07 22:38:01 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fc4db453-5679-4ce9-adf1-64ba4ea10391" returned: 0 in 0.716s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-fc4db453-5679-4ce9-adf1-64ba4ea10391" released by "delete_volume" :: held 1.616s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Created reservations ['32796de8-7ac0-43cf-a18c-8dd01a73ad54', 'c7f60908-60c2-4bd3-9c8a-368c9b2a4cf8', '1b861890-b34d-458c-b6e9-f35675e1fe8e', '24379a0a-4b1c-44ff-b7fb-e5f1983500b5'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-533050c7-b840-4782-a8ae-2e47523d74a9-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:01 devstack sudo[93027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:01 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-533050c7-b840-4782-a8ae-2e47523d74a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-533050c7-b840-4782-a8ae-2e47523d74a9" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-533050c7-b840-4782-a8ae-2e47523d74a9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Deleting offline snapshot 533050c7-b840-4782-a8ae-2e47523d74a9 of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] snapshot_file for this snap is: volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f4d12-862d-4bcb-8f4a-f2f92e04ee8a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:01 devstack sudo[93029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9
Jul 07 22:38:01 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-d266243e-7f41-4a42-91f2-2885d84ea929-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "cinder-d266243e-7f41-4a42-91f2-2885d84ea929-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-quobyte-d266243e-7f41-4a42-91f2-2885d84ea929" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-d266243e-7f41-4a42-91f2-2885d84ea929" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb847df3-13de-492a-ac68-0f8cd7a75a44]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:02 devstack sudo[93031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929
Jul 07 22:38:02 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:02 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Deleted volume successfully.
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c70e38ec-bc54-49de-8ddf-a22d6a69ec75 tempest-VolumesTestJSON-1384381727 None] Lock "cinder-fc4db453-5679-4ce9-adf1-64ba4ea10391-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:02 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9" returned: 0 in 0.880s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcca2a-e8b2-4885-8478-7ecab61f7cb6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:02 devstack sudo[93037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:02 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:02 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929" returned: 0 in 1.011s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:02 devstack sudo[93044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929
Jul 07 22:38:02 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:03 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 1.107s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:03 devstack sudo[93049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9
Jul 07 22:38:03 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:03 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d266243e-7f41-4a42-91f2-2885d84ea929" returned: 0 in 0.858s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-d266243e-7f41-4a42-91f2-2885d84ea929" released by "delete_volume" :: held 1.922s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:03 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Created reservations ['f9c0238b-9214-40fa-81b5-804440970bdf', '8a9e2160-fac3-4224-b910-9a683567dcc5', '9331c900-6a0e-4cf5-a8ef-608a51ee0d6c', 'c6dd3482-b08e-4546-a960-5e6b0e7f1ba1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:04 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:04 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-1e48ba24-3a98-4626-a38b-f22934a635a7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "cinder-1e48ba24-3a98-4626-a38b-f22934a635a7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Acquiring lock "cinder-quobyte-1e48ba24-3a98-4626-a38b-f22934a635a7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-1e48ba24-3a98-4626-a38b-f22934a635a7" acquired by "delete_volume" :: waited 0.049s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c095ee2-dd3f-487c-a6de-bedeb0c70c74]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:04 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7
Jul 07 22:38:04 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:04 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9" returned: 0 in 1.326s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:04 devstack sudo[93072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9
Jul 07 22:38:04 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:05 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.218s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Deleted volume successfully.
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4ab0faba-a906-4968-87b9-5374c01ce83f tempest-VolumesTestJSON-1384381727 None] Lock "cinder-d266243e-7f41-4a42-91f2-2885d84ea929-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:05 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7" returned: 0 in 1.095s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:05 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7
Jul 07 22:38:05 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:05 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.533050c7-b840-4782-a8ae-2e47523d74a9" returned: 0 in 0.799s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-533050c7-b840-4782-a8ae-2e47523d74a9" released by "_delete_snapshot" :: held 4.215s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_snapshot" :: held 4.241s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Created reservations ['852f92b0-3f1d-4c67-865c-317e3b739719', '21c651de-5f9f-4131-a7a3-854d079cbfdc', '4b9dae20-c42e-468e-bf3a-fd58b3b83bb6', 'ed489657-8804-47c5-b722-0cbbe0c610e2'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Delete snapshot completed successfully.
Jul 07 22:38:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4666b0ed-355e-4ce6-90ee-96f0440022be tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-533050c7-b840-4782-a8ae-2e47523d74a9-delete_snapshot" released by "delete_snapshot" :: held 4.445s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:06 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1e48ba24-3a98-4626-a38b-f22934a635a7" returned: 0 in 0.732s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "cinder-quobyte-1e48ba24-3a98-4626-a38b-f22934a635a7" released by "delete_volume" :: held 1.894s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Created reservations ['cc84e1a9-6707-4f85-ba6e-704124b93a33', '1e737740-a6f5-4193-974f-0d6f1d46eab2', 'b403541b-aad4-4898-924c-4730d2bed5fc', '5619cedb-e59e-49d2-9916-286ce2c05a21'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:06 devstack sudo[93088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:06 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:07 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.885s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Deleted volume successfully.
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-463101ed-ef21-4b72-88f3-7c77d8b534de tempest-VolumesTestJSON-1384381727 None] Lock "cinder-1e48ba24-3a98-4626-a38b-f22934a635a7-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Creating offline snapshot 6c8652ba-a371-4375-ba6b-c0da60619169 of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883bf05-f94f-4c46-8dd9-aaee54c52118]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:07 devstack sudo[93093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:07 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:08 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.905s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:08 devstack sudo[93098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 1G
Jul 07 22:38:08 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:09 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 1G" returned: 0 in 1.514s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:09 devstack sudo[93147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169
Jul 07 22:38:09 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:11 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169" returned: 0 in 1.346s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:11 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 is being set with open permissions: ugo+rw
Jul 07 22:38:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:11 devstack sudo[93174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169
Jul 07 22:38:11 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:12 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169" returned: 0 in 1.017s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.931s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ccf838b1-6c12-412e-877e-4cb452b5de3c tempest-SnapshotsActionsTest-52495871 None] Create snapshot completed successfully
Jul 07 22:38:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8f3c98d1-2a22-45fe-bc21-c7991e029075 tempest-GroupSnapshotsV319Test-1219457988 None] Group tempest-GroupSnapshotsV319Test-Group-1168435794: creating
Jul 07 22:38:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8f3c98d1-2a22-45fe-bc21-c7991e029075 tempest-GroupSnapshotsV319Test-1219457988 None] Group tempest-GroupSnapshotsV319Test-Group-1168435794: created successfully
Jul 07 22:38:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8f3c98d1-2a22-45fe-bc21-c7991e029075 tempest-GroupSnapshotsV319Test-1219457988 None] Create group completed successfully.
Jul 07 22:38:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-6c8652ba-a371-4375-ba6b-c0da60619169-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-6c8652ba-a371-4375-ba6b-c0da60619169-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_snapshot" :: waited 0.042s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-6c8652ba-a371-4375-ba6b-c0da60619169" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-6c8652ba-a371-4375-ba6b-c0da60619169" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Deleting offline snapshot 6c8652ba-a371-4375-ba6b-c0da60619169 of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] snapshot_file for this snap is: volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec1fd75-de9b-49d8-a294-3906d4597b18]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:13 devstack sudo[93207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169
Jul 07 22:38:13 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:14 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169" returned: 0 in 0.928s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4803f04-88b2-43a6-8d11-36ba1c16e9f6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:14 devstack sudo[93222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:14 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Flow 'volume_create_manager' (4c7288c0-3c6b-486d-96d5-fca633f2b7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7c91ef-4488-41e7-a602-7a1ac3c4f9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c7c91ef-4488-41e7-a602-7a1ac3c4f9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223945489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac1efca1-8085-4df3-a5a8-6c87fe4db18a,host='devstack@QuobyteHD#QuobyteHD',id=04f0970b-e106-4672-bba3-c725f7555678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc4c8b0334477aa991af0b73042a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:15Z,use_quota=True,user_id='3820ec2e995c4c2581841afcbb0bcf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5760d129-cb96-4c41-88b9-a62c362d5ef8),volume_type_id=5760d129-cb96-4c41-88b9-a62c362d5ef8)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22baeb44-3d6d-4a63-b6fb-06973a5d8a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22baeb44-3d6d-4a63-b6fb-06973a5d8a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e5aea-b14e-49eb-99f4-0e5a1ae27deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05e5aea-b14e-49eb-99f4-0e5a1ae27deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f0970b-e106-4672-bba3-c725f7555678', 'volume_name': 'volume-04f0970b-e106-4672-bba3-c725f7555678', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae380270-6c02-4894-942b-6f5ebc9883d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae380270-6c02-4894-942b-6f5ebc9883d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d78a1-e788-44ae-bd97-b6e852ec3e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Volume 04f0970b-e106-4672-bba3-c725f7555678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f0970b-e106-4672-bba3-c725f7555678', 'volume_size': 1}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=ac1efca1-8085-4df3-a5a8-6c87fe4db18a,created_at=2026-07-07T20:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-223945489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=ac1efca1-8085-4df3-a5a8-6c87fe4db18a,host='devstack@QuobyteHD#QuobyteHD',id=04f0970b-e106-4672-bba3-c725f7555678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cbc4c8b0334477aa991af0b73042a47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:15Z,use_quota=True,user_id='3820ec2e995c4c2581841afcbb0bcf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5760d129-cb96-4c41-88b9-a62c362d5ef8),volume_type_id=5760d129-cb96-4c41-88b9-a62c362d5ef8)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Creating volume 04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:38:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:15 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 1073741824
Jul 07 22:38:15 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:15 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 1.593s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:15 devstack sudo[93230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169
Jul 07 22:38:15 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:16 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 1073741824" returned: 0 in 1.249s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:16 devstack sudo[93238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678
Jul 07 22:38:16 devstack sudo[93238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:16 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169" returned: 0 in 1.294s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:17 devstack sudo[93244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169
Jul 07 22:38:17 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:17 devstack sudo[93238]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678" returned: 0 in 0.982s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b5d78a1-e788-44ae-bd97-b6e852ec3e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f0970b-e106-4672-bba3-c725f7555678', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509dfceb-e15d-4580-b76a-a39a6b2a3ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Volume volume-04f0970b-e106-4672-bba3-c725f7555678 (04f0970b-e106-4672-bba3-c725f7555678): created successfully
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509dfceb-e15d-4580-b76a-a39a6b2a3ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Flow 'volume_create_manager' (4c7288c0-3c6b-486d-96d5-fca633f2b7d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e89d48f4-288b-429a-b512-69908c3892ff tempest-GroupSnapshotsV319Test-1219457988 None] Created volume successfully.
Jul 07 22:38:18 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6c8652ba-a371-4375-ba6b-c0da60619169" returned: 0 in 1.084s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-6c8652ba-a371-4375-ba6b-c0da60619169" released by "_delete_snapshot" :: held 5.070s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_snapshot" :: held 5.118s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Created reservations ['0b322143-2849-4abd-a290-ad49295e97a3', 'd449c06a-4df2-479a-a577-9e1bd50b987c', 'ee90c088-8fae-4722-9fb2-20b9f9e73598', '61ac3bb8-e789-4add-bf4e-4abdc48a0f6d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:18 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Delete snapshot completed successfully.
Jul 07 22:38:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5db7c54b-aa6a-4e0e-88a7-185d509a6055 tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-6c8652ba-a371-4375-ba6b-c0da60619169-delete_snapshot" released by "delete_snapshot" :: held 5.385s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] GroupSnapshot c55d145e-f789-46a7-b440-24edc9ea4193: creating.
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Group snapshot c55d145e-f789-46a7-b440-24edc9ea4193: creating. {{(pid=88152) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Creating offline snapshot 09ea2ce3-bd08-4379-9b6b-60a04ad60d95 of volume 04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[410887af-b6bd-40c4-ae9c-ad3c4116df1a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:19 devstack sudo[93298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678
Jul 07 22:38:19 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:20 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678" returned: 0 in 0.971s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:20 devstack sudo[93323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 1G
Jul 07 22:38:20 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:21 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 1G" returned: 0 in 1.113s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0970b-e106-4672-bba3-c725f7555678 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:21 devstack sudo[93332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0970b-e106-4672-bba3-c725f7555678 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95
Jul 07 22:38:21 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:22 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04f0970b-e106-4672-bba3-c725f7555678 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95" returned: 0 in 0.972s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:22 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:22 devstack sudo[93337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95
Jul 07 22:38:22 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:23 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95" returned: 0 in 0.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:23 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info
Jul 07 22:38:23 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:23 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info" returned: 0 in 0.703s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:23 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:23 devstack sudo[93343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info
Jul 07 22:38:23 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:24 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.info" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.255s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.728s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Creating offline snapshot 2ade0570-cf3b-42a3-9179-9f31b10a232d of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[009b34fb-fd18-44d5-8435-1a3d5dc16252]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:24 devstack sudo[93385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:24 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:24 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e374638e-6900-417f-80c6-df572b58dddd tempest-GroupSnapshotsV319Test-1219457988 None] group_snapshot c55d145e-f789-46a7-b440-24edc9ea4193: created successfully
Jul 07 22:38:25 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:25 devstack sudo[93391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d 1G
Jul 07 22:38:25 devstack sudo[93391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] group_snapshot c55d145e-f789-46a7-b440-24edc9ea4193: deleting
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] group_snapshot c55d145e-f789-46a7-b440-24edc9ea4193: deleting {{(pid=88152) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "cinder-quobyte-09ea2ce3-bd08-4379-9b6b-60a04ad60d95" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-09ea2ce3-bd08-4379-9b6b-60a04ad60d95" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Deleting offline snapshot 09ea2ce3-bd08-4379-9b6b-60a04ad60d95 of volume 04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] snapshot_file for this snap is: volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb48a8b6-7509-4446-a5ba-28236fc1345b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:26 devstack sudo[93396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95
Jul 07 22:38:26 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:26 devstack sudo[93391]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d 1G" returned: 0 in 0.980s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:26 devstack sudo[93398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d
Jul 07 22:38:26 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:27 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95" returned: 0 in 0.807s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04f0970b-e106-4672-bba3-c725f7555678(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc4c331-f428-4333-a427-61ce77a8fcdc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:27 devstack sudo[93405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678
Jul 07 22:38:27 devstack sudo[93405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:27 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d" returned: 0 in 0.772s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:27 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d is being set with open permissions: ugo+rw
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:27 devstack sudo[93408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d
Jul 07 22:38:27 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:27 devstack sudo[93405]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:27 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d" returned: 0 in 0.689s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:27 devstack sudo[93414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95
Jul 07 22:38:27 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.366s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-06667e4c-686a-4982-b5f6-f79e2c00ad9e tempest-SnapshotsActionsTest-52495871 None] Create snapshot completed successfully
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-2ade0570-cf3b-42a3-9179-9f31b10a232d-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-2ade0570-cf3b-42a3-9179-9f31b10a232d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Acquiring lock "cinder-quobyte-2ade0570-cf3b-42a3-9179-9f31b10a232d" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-2ade0570-cf3b-42a3-9179-9f31b10a232d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Deleting offline snapshot 2ade0570-cf3b-42a3-9179-9f31b10a232d of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] snapshot_file for this snap is: volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aade687-fd60-45ee-b271-4c9d4e451358]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:28 devstack sudo[93416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d
Jul 07 22:38:28 devstack sudo[93416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:28 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95" returned: 0 in 0.862s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:28 devstack sudo[93421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95
Jul 07 22:38:28 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:29 devstack sudo[93416]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:29 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d" returned: 0 in 0.916s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678.09ea2ce3-bd08-4379-9b6b-60a04ad60d95" returned: 0 in 0.686s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65c8440-e3ec-4c84-b39d-47e0d5426736]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-09ea2ce3-bd08-4379-9b6b-60a04ad60d95" released by "_delete_snapshot" :: held 3.304s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" released by "delete_snapshot" :: held 3.340s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:29 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1023054785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1023054785, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:29 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1023054785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1023054785, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:29 devstack sudo[93428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:29 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:29 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] Created reservations ['87612bd0-1c7d-4407-8257-ac73f69674cf', '45a72da0-91fe-487e-aa0b-1b877e0262a7', '67f65341-8627-479a-89ba-e2982523f645', '34fa9db0-3e5f-4a4c-a89a-cf4effbbccfb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d837207a-04c7-4f87-91be-b1778d223ceb tempest-GroupSnapshotsV319Test-1219457988 None] group_snapshot c55d145e-f789-46a7-b440-24edc9ea4193: deleted successfully
Jul 07 22:38:30 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.837s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:30 devstack sudo[93433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d
Jul 07 22:38:30 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de80797-16dd-494c-884d-4fd06c6d8cb6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:31 devstack sudo[93438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678
Jul 07 22:38:31 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:31 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d" returned: 0 in 1.057s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:31 devstack sudo[93440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d
Jul 07 22:38:31 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:32 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.2ade0570-cf3b-42a3-9179-9f31b10a232d" returned: 0 in 0.733s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:32 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678" returned: 0 in 1.027s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-2ade0570-cf3b-42a3-9179-9f31b10a232d" released by "_delete_snapshot" :: held 3.700s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_snapshot" :: held 3.741s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:32 devstack sudo[93447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=77,cinder:UPDATE=75,cinder:INSERT=18,cinder:DELETE=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:38:32 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Created reservations ['846acd4c-1a5a-4769-adb4-b6ca8de0c335', '60f195b4-b49f-46c0-995a-4e81b4cf96ef', 'eed3b83f-19cf-4b8e-b14f-f4eff441a6c9', '38aec74f-329f-437f-8399-186b23c5138a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Delete snapshot completed successfully.
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f61d428e-29b6-4c5d-9873-f7ee6b3c02ee tempest-SnapshotsActionsTest-360165488 None] Lock "cinder-2ade0570-cf3b-42a3-9179-9f31b10a232d-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:32 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-04f0970b-e106-4672-bba3-c725f7555678" returned: 0 in 0.761s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Lock "cinder-quobyte-04f0970b-e106-4672-bba3-c725f7555678" released by "delete_volume" :: held 1.877s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:32 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:DELETE=9,cinder:INSERT=20 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Created reservations ['81001f70-1ed9-4a14-9fae-35b40af34326'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:33 devstack cinder-volume[88152]: WARNING cinder.quota [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1023054785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1023054785, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Created reservations ['7ae8df68-6f73-43ab-8f5e-918d872be2d9', '353cbbbb-b3c6-4a6a-960c-3c427db943dc', 'd40d3c90-8826-4e08-9a0d-878a0392ca23', '04e7e022-be39-4d76-8e4e-6d3853ff2cd8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "cinder-6a05000d-6b9c-4804-9774-7eacd89e616c-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-6a05000d-6b9c-4804-9774-7eacd89e616c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:33 devstack sudo[93450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:33 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "cinder-quobyte-6a05000d-6b9c-4804-9774-7eacd89e616c" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-6a05000d-6b9c-4804-9774-7eacd89e616c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Deleting offline snapshot 6a05000d-6b9c-4804-9774-7eacd89e616c of volume b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] snapshot_file for this snap is: volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f6045-8a84-4217-a0d9-0b391d62ce6c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:33 devstack sudo[93452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:33 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:33 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:33 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:34 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.774s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-934c4457-14b9-407e-8ace-2c463810c85b tempest-GroupSnapshotsV319Test-1219457988 None] Delete group completed successfully.
Jul 07 22:38:34 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.880s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f259c-9ee0-4b96-b3b3-fb7f44f8f770]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:34 devstack sudo[93463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a
Jul 07 22:38:34 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:34 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.708s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 8 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:38:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:38:35 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:35 devstack sudo[93470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:35 devstack sudo[93470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:35 devstack sudo[93470]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.801s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:35 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c
Jul 07 22:38:35 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:36 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a.6a05000d-6b9c-4804-9774-7eacd89e616c" returned: 0 in 0.671s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-6a05000d-6b9c-4804-9774-7eacd89e616c" released by "_delete_snapshot" :: held 3.304s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_snapshot" :: held 3.328s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:36 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Created reservations ['d369bfed-9c3a-4713-9417-fbe594416c10', 'bd83947a-f135-49c1-bf8b-a977be3190ae', '4a0813ad-e89b-4da1-a273-4f5683d9f51c', '9ba70fe2-3ddd-45f3-8769-7cf7036618ff'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Delete snapshot completed successfully.
Jul 07 22:38:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-16a18502-1f23-418f-806e-4aa90093847d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-6a05000d-6b9c-4804-9774-7eacd89e616c-delete_snapshot" released by "delete_snapshot" :: held 3.478s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "cinder-b16f4afe-8f83-46f9-88d7-0f4f5d03544a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-b16f4afe-8f83-46f9-88d7-0f4f5d03544a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc4ceb-2f18-40af-a177-8b713a70c8d2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (32453379-6606-468d-963a-ddd4b66e9c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d55b6a-0f0e-4201-b31d-45bf74a05725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d55b6a-0f0e-4201-b31d-45bf74a05725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1430476927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e6dc9f-ba4b-430c-81c7-112e48923326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:38Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad732ba-9fe4-4ab2-b656-6d262714371a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad732ba-9fe4-4ab2-b656-6d262714371a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa77be-90e0-4fb2-b35f-45da269b3af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73aa77be-90e0-4fb2-b35f-45da269b3af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e6dc9f-ba4b-430c-81c7-112e48923326', 'volume_name': 'volume-e9e6dc9f-ba4b-430c-81c7-112e48923326', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f7c53d-170c-4afc-af82-c4493f3b4207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f7c53d-170c-4afc-af82-c4493f3b4207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6a5b77-efa6-4062-9577-54bea7f7ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Volume e9e6dc9f-ba4b-430c-81c7-112e48923326: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e6dc9f-ba4b-430c-81c7-112e48923326', 'volume_size': 1}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1430476927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e6dc9f-ba4b-430c-81c7-112e48923326,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:38Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Creating volume e9e6dc9f-ba4b-430c-81c7-112e48923326 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:38:37 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:38:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:37 devstack sudo[93490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a
Jul 07 22:38:37 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:37 devstack sudo[93492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 1073741824
Jul 07 22:38:37 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:38 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" returned: 0 in 0.878s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:38 devstack sudo[93502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a
Jul 07 22:38:38 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:38 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 1073741824" returned: 0 in 0.991s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:39 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326
Jul 07 22:38:39 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:39 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-quobyte-b16f4afe-8f83-46f9-88d7-0f4f5d03544a" released by "delete_volume" :: held 1.734s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Created reservations ['1643b3ce-8ed8-43fa-b894-cf6f0ca9411b', '5f3f7d33-0055-45c1-8d5b-47404ac46d6c', 'c81f07ad-a411-43ca-92e5-1ed167e26f7b', '4cf39843-a142-4c5e-ac99-cf87b311d30c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:39 devstack sudo[93507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:39 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:39 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326" returned: 0 in 0.851s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6a5b77-efa6-4062-9577-54bea7f7ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e6dc9f-ba4b-430c-81c7-112e48923326', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d0e4c-5094-4635-950a-afea1572cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Volume volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 (e9e6dc9f-ba4b-430c-81c7-112e48923326): created successfully
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7d0e4c-5094-4635-950a-afea1572cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (32453379-6606-468d-963a-ddd4b66e9c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-17ddbe98-74de-4ebd-b0fa-fd65760355d0 tempest-AttachVolumeTestJSON-727612247 None] Created volume successfully.
Jul 07 22:38:40 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:40 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Deleted volume successfully.
Jul 07 22:38:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6adc7bde-0ab9-4e5d-8bc4-e0201f56a86d tempest-SnapshotsActionsTest-52495871 None] Lock "cinder-b16f4afe-8f83-46f9-88d7-0f4f5d03544a-delete_volume" released by "delete_volume" :: held 2.870s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c5d86a-70cb-40be-bf00-a2231941f6cf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:44 devstack sudo[93529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326
Jul 07 22:38:44 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:45 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326" returned: 0 in 1.104s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.131s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-e9e6dc9f-ba4b-430c-81c7-112e48923326', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bc5ef81-c7a2-4616-80f9-efbc87caff08', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:38:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-712bad2c-723d-4e95-95c9-6c86f107fae8 req-355516e9-73ee-4ac5-a199-2e539c3952dc tempest-AttachVolumeTestJSON-727612247 None] attachment_update completed successfully.
Jul 07 22:38:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4ad9d7b8-1dbc-468c-8514-52a267eeafe6 tempest-GroupsV314Test-87072858 None] Group tempest-GroupsV314Test-Group-1145909555: creating
Jul 07 22:38:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4ad9d7b8-1dbc-468c-8514-52a267eeafe6 tempest-GroupsV314Test-87072858 None] Group tempest-GroupsV314Test-Group-1145909555: created successfully
Jul 07 22:38:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4ad9d7b8-1dbc-468c-8514-52a267eeafe6 tempest-GroupsV314Test-87072858 None] Create group completed successfully.
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Flow 'volume_create_manager' (c89afd5c-03ea-4468-834a-a62790b9d141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e2ac20-3bdc-46c2-9791-e582b991db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e2ac20-3bdc-46c2-9791-e582b991db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043354769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2acd7222-ae11-4fb9-8c38-b08e55685a9d,host='devstack@QuobyteHD#QuobyteHD',id=cd00209f-2311-4ddd-b24d-ff63a14e7063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3e806ee4d244189961e098a279b2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:49Z,use_quota=True,user_id='f8dfa07c83a34197bdc28af4cb11fd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4334f468-e9a4-41f9-9d9f-3823788e1681),volume_type_id=4334f468-e9a4-41f9-9d9f-3823788e1681)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258a6ab4-c861-434b-a335-95d704373954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258a6ab4-c861-434b-a335-95d704373954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76238ccc-3b54-43f8-8d49-8e2f70603c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76238ccc-3b54-43f8-8d49-8e2f70603c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd00209f-2311-4ddd-b24d-ff63a14e7063', 'volume_name': 'volume-cd00209f-2311-4ddd-b24d-ff63a14e7063', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad119f26-f966-4d4a-86b7-f2fdf86559ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad119f26-f966-4d4a-86b7-f2fdf86559ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef548d6d-cd69-4bac-9104-80a4b05a1acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Volume cd00209f-2311-4ddd-b24d-ff63a14e7063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd00209f-2311-4ddd-b24d-ff63a14e7063', 'volume_size': 1}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=2acd7222-ae11-4fb9-8c38-b08e55685a9d,created_at=2026-07-07T20:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043354769',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=2acd7222-ae11-4fb9-8c38-b08e55685a9d,host='devstack@QuobyteHD#QuobyteHD',id=cd00209f-2311-4ddd-b24d-ff63a14e7063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe3e806ee4d244189961e098a279b2d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:49Z,use_quota=True,user_id='f8dfa07c83a34197bdc28af4cb11fd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4334f468-e9a4-41f9-9d9f-3823788e1681),volume_type_id=4334f468-e9a4-41f9-9d9f-3823788e1681)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Creating volume cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:38:49 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:38:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:49 devstack sudo[93939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 1073741824
Jul 07 22:38:49 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:49 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 1073741824" returned: 0 in 0.952s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:50 devstack sudo[93945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:38:50 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:50 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 0.884s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:38:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef548d6d-cd69-4bac-9104-80a4b05a1acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd00209f-2311-4ddd-b24d-ff63a14e7063', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a394ba1f-354f-4f2c-9aae-e868eb1359a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Volume volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 (cd00209f-2311-4ddd-b24d-ff63a14e7063): created successfully
Jul 07 22:38:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a394ba1f-354f-4f2c-9aae-e868eb1359a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Flow 'volume_create_manager' (c89afd5c-03ea-4468-834a-a62790b9d141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-301af737-526f-4c48-b4fe-4f92c0aa92e0 tempest-GroupsV314Test-87072858 None] Created volume successfully.
Jul 07 22:38:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:52 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Cloning volume cd00209f-2311-4ddd-b24d-ff63a14e7063 to volume f899103d-9771-4edd-8089-a5663931ccf9
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Creating offline snapshot a86575aa-17e3-46d7-9c32-e491ef34f59b of volume cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1cbbec-f483-4291-98f4-cae8624bc47e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:53 devstack sudo[93992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:38:53 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Acquiring lock "cinder-0c2e121b-8293-42b6-a336-11b89abda1a4-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "cinder-0c2e121b-8293-42b6-a336-11b89abda1a4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Acquiring lock "cinder-quobyte-0c2e121b-8293-42b6-a336-11b89abda1a4" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "cinder-quobyte-0c2e121b-8293-42b6-a336-11b89abda1a4" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231d64f-be7f-463e-9a0c-a64250ac18bf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:53 devstack sudo[93995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4
Jul 07 22:38:53 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:54 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 0.958s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:54 devstack sudo[94000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b 1G
Jul 07 22:38:54 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Flow 'volume_create_manager' (7f9c8a08-2919-418b-b18b-05d763d08549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccc9071-91b5-4f1c-9997-5392ac44f591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:54 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4" returned: 0 in 1.185s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccc9071-91b5-4f1c-9997-5392ac44f591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-760738403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ba818d-73bb-4bb1-b936-07ebe5096c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66495d2ea95147459ebb7bf74dd7b5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:55Z,use_quota=True,user_id='c76c3e91721b4d63a31413a3fa04e319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bc4951-df36-4727-8bf1-0c698bf8727c),volume_type_id=45bc4951-df36-4727-8bf1-0c698bf8727c)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a148ba5-16e4-4463-9710-9416668b60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:54 devstack sudo[94015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a148ba5-16e4-4463-9710-9416668b60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:54 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13178f3-7882-4db9-bae3-3ae719e40567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e13178f3-7882-4db9-bae3-3ae719e40567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63ba818d-73bb-4bb1-b936-07ebe5096c2b', 'volume_name': 'volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06031060-0c0a-4a0d-83d3-0de5c1c6ac2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06031060-0c0a-4a0d-83d3-0de5c1c6ac2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984860e-3803-4d18-a1e6-fa2524767853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:38:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Volume 63ba818d-73bb-4bb1-b936-07ebe5096c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b', 'volume_size': 1}
Jul 07 22:38:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:55 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b 1G" returned: 0 in 1.178s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:55 devstack sudo[94022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:38:55 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:55 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c2e121b-8293-42b6-a336-11b89abda1a4" returned: 0 in 0.700s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "cinder-quobyte-0c2e121b-8293-42b6-a336-11b89abda1a4" released by "delete_volume" :: held 1.946s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Created reservations ['53283757-da65-4b7a-a302-2fb457d1f7fa', 'c272fa6f-4c1e-4cde-8d4b-4b3ade102e9b', '9fb1293a-e6b9-4d84-913c-b21aa1c034bf', 'f692959d-f26e-458a-aede-f916a8c6a0e8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:55 devstack sudo[94025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:38:55 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:56 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 0.901s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:56 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:56 devstack sudo[94030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:38:56 devstack sudo[94030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:56 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.930s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:56 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:38:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Deleted volume successfully.
Jul 07 22:38:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f29d21fc-ebeb-42fe-ba5c-8997cd58c070 tempest-AttachVolumeShelveTestJSON-25861693 None] Lock "cinder-0c2e121b-8293-42b6-a336-11b89abda1a4-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:38:57 devstack sudo[94030]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 0.928s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:57 devstack sudo[94034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info
Jul 07 22:38:57 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:57 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info" returned: 0 in 0.760s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:57 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:38:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:57 devstack sudo[94039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info
Jul 07 22:38:57 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:58 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.info" returned: 0 in 0.696s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Acquiring lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] snapshot: a86575aa-17e3-46d7-9c32-e491ef34f59b, volume: f899103d-9771-4edd-8089-a5663931ccf9,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[421a4173-81d7-4c27-a0a3-ea683dbe742c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:58 devstack sudo[94043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:38:58 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:38:59 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 0.942s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd00209f-2311-4ddd-b24d-ff63a14e7063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5dc45c-08bb-4df3-86c5-3314aaa15fae]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:38:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:38:59 devstack sudo[94049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:38:59 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:00 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 1.130s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:00 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:39:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:00 devstack sudo[94095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9
Jul 07 22:39:00 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=34,cinder:INSERT=8,cinder:UPDATE=43 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:39:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=50,cinder:INSERT=15,cinder:UPDATE=45,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:39:07 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9" returned: 0 in 6.696s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:07 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc47fe-8e16-4039-89d4-5462321682dc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:07 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:39:07 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:09 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 1.557s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063, size 1024.00 MB, duration 6.70 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:39:09 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Converted 1024.00 MB image at 152.91 MB/s
Jul 07 22:39:09 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:09 devstack sudo[94592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9
Jul 07 22:39:09 devstack sudo[94592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:09 devstack sudo[94592]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9" returned: 0 in 0.853s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" released by "_copy_volume_from_snapshot" :: held 11.293s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Acquiring lock "cinder-quobyte-a86575aa-17e3-46d7-9c32-e491ef34f59b" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-a86575aa-17e3-46d7-9c32-e491ef34f59b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Deleting offline snapshot a86575aa-17e3-46d7-9c32-e491ef34f59b of volume cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] snapshot_file for this snap is: volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea68f0d2-f617-4ac7-ad5c-e3b30a13b241]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:10 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:39:10 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:11 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 1.093s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd00209f-2311-4ddd-b24d-ff63a14e7063(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:39:11 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e320446e-4a3d-4b02-ba13-9ba811585799]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:11 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:39:11 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:12 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 1.040s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:12 devstack sudo[94607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:39:12 devstack sudo[94607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:13 devstack sudo[94607]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 0.925s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:13 devstack sudo[94612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b
Jul 07 22:39:13 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:13 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063.a86575aa-17e3-46d7-9c32-e491ef34f59b" returned: 0 in 0.862s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-a86575aa-17e3-46d7-9c32-e491ef34f59b" released by "_delete_snapshot" :: held 4.041s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.032s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.130s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-760738403',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63ba818d-73bb-4bb1-b936-07ebe5096c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66495d2ea95147459ebb7bf74dd7b5a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:38:55Z,use_quota=True,user_id='c76c3e91721b4d63a31413a3fa04e319',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45bc4951-df36-4727-8bf1-0c698bf8727c),volume_type_id=45bc4951-df36-4727-8bf1-0c698bf8727c)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Creating volume 63ba818d-73bb-4bb1-b936-07ebe5096c2b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:14 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:39:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:14 devstack sudo[94616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b 1073741824
Jul 07 22:39:14 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e1f6115b-67a7-4726-8761-61acb85a56d5 tempest-GroupsV314Test-87072858 None] Create group from source-group-2acd7222-ae11-4fb9-8c38-b08e55685a9d completed successfully.
Jul 07 22:39:15 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b 1073741824" returned: 0 in 1.275s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Acquiring lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb56c172-8a7f-4837-b11b-8f4b6e136ed1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:15 devstack sudo[94622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b
Jul 07 22:39:15 devstack sudo[94622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:15 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9
Jul 07 22:39:15 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:16 devstack sudo[94622]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b" returned: 0 in 1.404s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.780s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d984860e-3803-4d18-a1e6-fa2524767853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5700e27d-db06-4e93-b2d6-78df5071de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:16 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Volume volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b (63ba818d-73bb-4bb1-b936-07ebe5096c2b): created successfully
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5700e27d-db06-4e93-b2d6-78df5071de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Flow 'volume_create_manager' (7f9c8a08-2919-418b-b18b-05d763d08549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:16 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9" returned: 0 in 1.508s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6dc511e6-392f-4699-a67e-edc28d19d6a5 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Created volume successfully.
Jul 07 22:39:16 devstack sudo[94630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9
Jul 07 22:39:16 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:18 devstack sudo[94633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:18 devstack sudo[94633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:18 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f899103d-9771-4edd-8089-a5663931ccf9" returned: 0 in 1.288s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-f899103d-9771-4edd-8089-a5663931ccf9" released by "delete_volume" :: held 2.870s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Created reservations ['6261e149-eb04-4027-964e-3fdcba4614a3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:18 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-883398491 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-883398491, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:18 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-883398491 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-883398491, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Created reservations ['105940d0-50a8-4b54-bae8-51a6a50cc8e7', '31e18779-bf2e-48d6-b17c-60bae1cf1059', '06f34a37-5e11-430f-a189-b86d022951d7', 'ef6cc38b-dfd4-454a-8ee2-9cb2a38f375a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:18 devstack sudo[94635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:18 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:19 devstack sudo[94633]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.362s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4239aa55-ca84-48a3-b8cf-ca6082935a67 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Retype volume completed successfully.
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "cinder-63ba818d-73bb-4bb1-b936-07ebe5096c2b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "cinder-63ba818d-73bb-4bb1-b936-07ebe5096c2b-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Acquiring lock "cinder-quobyte-cd00209f-2311-4ddd-b24d-ff63a14e7063" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "cinder-quobyte-63ba818d-73bb-4bb1-b936-07ebe5096c2b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-cd00209f-2311-4ddd-b24d-ff63a14e7063" acquired by "delete_volume" :: waited 0.037s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "cinder-quobyte-63ba818d-73bb-4bb1-b936-07ebe5096c2b" acquired by "delete_volume" :: waited 0.091s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3ec998-5308-4ac0-b0ce-a62e846eb258]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7307f0e2-9ef9-4855-b1a3-d10a7ad63ef5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:20 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.468s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:20 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d5ffe21c-55eb-46aa-b868-00ce47f21d51 tempest-GroupsV314Test-87072858 None] Delete group completed successfully.
Jul 07 22:39:20 devstack sudo[94640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b
Jul 07 22:39:20 devstack sudo[94640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:20 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:39:20 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:21 devstack sudo[94640]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b" returned: 0 in 1.233s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:21 devstack sudo[94648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b
Jul 07 22:39:21 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:21 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 1.505s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:21 devstack sudo[94684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063
Jul 07 22:39:21 devstack sudo[94684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:22 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-63ba818d-73bb-4bb1-b936-07ebe5096c2b" returned: 0 in 1.052s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "cinder-quobyte-63ba818d-73bb-4bb1-b936-07ebe5096c2b" released by "delete_volume" :: held 2.382s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:22 devstack cinder-volume[88152]: WARNING cinder.quota [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:22 devstack cinder-volume[88152]: WARNING cinder.quota [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Created reservations ['365a85a0-2955-4d82-b418-48fad209455b', '5c22464f-fdc7-4e73-bf92-e59649e59961', '9fd10db1-624b-4b4f-862f-d00c1df5032b', '4808abc4-32b6-432b-bd5c-2d332655c24d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:22 devstack sudo[94684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cd00209f-2311-4ddd-b24d-ff63a14e7063" returned: 0 in 1.083s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:22 devstack sudo[94688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:22 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Lock "cinder-quobyte-cd00209f-2311-4ddd-b24d-ff63a14e7063" released by "delete_volume" :: held 2.715s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Created reservations ['92b06ecf-17be-4951-87c4-83fe3043b287'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Created reservations ['9b3ca2bc-07d9-4b3d-8060-4f3fd7df8866', '1a3074fd-66c7-4272-847a-b89572d7426c', '3fb1d6e4-61fd-4db5-a77c-8fec96ede207', '1f9dcd95-642d-4fb1-a485-d9b27f38ba4a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:22 devstack sudo[94690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:22 devstack sudo[94690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:23 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.798s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:23 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Deleted volume successfully.
Jul 07 22:39:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7683d7c-1b62-406f-b1db-b769500bdb33 tempest-VolumeRetypeWithoutMigrationTest-569056820 None] Lock "cinder-63ba818d-73bb-4bb1-b936-07ebe5096c2b-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:23 devstack sudo[94690]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.932s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:23 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-af4f294d-af8b-4b14-986c-6bf3d430e548 tempest-GroupsV314Test-87072858 None] Delete group completed successfully.
Jul 07 22:39:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-5d321d94-e7ab-4aa0-a5ca-82eaeef2a206 req-b8a3e2e4-8594-47f1-b803-20aa324bf548 tempest-AttachVolumeTestJSON-727612247 None] Terminate volume connection completed successfully.
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-5d321d94-e7ab-4aa0-a5ca-82eaeef2a206 req-b8a3e2e4-8594-47f1-b803-20aa324bf548 tempest-AttachVolumeTestJSON-727612247 None] Deleting attachment 5bc5ef81-c7a2-4616-80f9-efbc87caff08. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Flow 'volume_create_manager' (24b9a518-5977-486a-a994-f6b0cc5f30d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692f4194-54e0-4caf-ac94-2d1bdbc9772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692f4194-54e0-4caf-ac94-2d1bdbc9772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-124204730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da77ded7-b097-413c-bdd1-c1791f235546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f61a6199f41e6bfaa095ef4b23ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:33Z,use_quota=True,user_id='1753356bcd9f497fa132d3359426b397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb4cea4-9e85-4943-b167-e785bd1432d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcb4cea4-9e85-4943-b167-e785bd1432d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2eb329e-823d-4ba7-b1b3-72e001e1de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2eb329e-823d-4ba7-b1b3-72e001e1de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da77ded7-b097-413c-bdd1-c1791f235546', 'volume_name': 'volume-da77ded7-b097-413c-bdd1-c1791f235546', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965e4a43-8099-4927-a0a0-002f572df11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965e4a43-8099-4927-a0a0-002f572df11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8c828a-730f-4d92-8f4e-5c120ecbaf03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Volume da77ded7-b097-413c-bdd1-c1791f235546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da77ded7-b097-413c-bdd1-c1791f235546', 'volume_size': 1}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-124204730',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da77ded7-b097-413c-bdd1-c1791f235546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='450f61a6199f41e6bfaa095ef4b23ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:33Z,use_quota=True,user_id='1753356bcd9f497fa132d3359426b397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Creating volume da77ded7-b097-413c-bdd1-c1791f235546 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:32 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:39:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:32 devstack sudo[94707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 1073741824
Jul 07 22:39:32 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:33 devstack sudo[94713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:33 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:34 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 1073741824" returned: 0 in 1.230s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:34 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546
Jul 07 22:39:34 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:35 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.464s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 8 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:39:35 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546" returned: 0 in 1.580s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] <== create_volume: return (2895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.898s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be8c828a-730f-4d92-8f4e-5c120ecbaf03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da77ded7-b097-413c-bdd1-c1791f235546', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a86fc5-9363-4703-825c-d234b702276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:35 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Volume volume-da77ded7-b097-413c-bdd1-c1791f235546 (da77ded7-b097-413c-bdd1-c1791f235546): created successfully
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a86fc5-9363-4703-825c-d234b702276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Flow 'volume_create_manager' (24b9a518-5977-486a-a994-f6b0cc5f30d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-51526ff3-1d60-4e9f-8e4c-7095f53b83f6 tempest-VolumesServicesTestJSON-877063600 None] Created volume successfully.
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Acquiring lock "cinder-da77ded7-b097-413c-bdd1-c1791f235546-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "cinder-da77ded7-b097-413c-bdd1-c1791f235546-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Acquiring lock "cinder-quobyte-da77ded7-b097-413c-bdd1-c1791f235546" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "cinder-quobyte-da77ded7-b097-413c-bdd1-c1791f235546" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[316d29b5-67c6-4433-beb5-2aff6d2f1f3b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:37 devstack sudo[94747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546
Jul 07 22:39:37 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:38 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546" returned: 0 in 1.030s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:38 devstack sudo[94754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546
Jul 07 22:39:38 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:39 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da77ded7-b097-413c-bdd1-c1791f235546" returned: 0 in 0.719s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "cinder-quobyte-da77ded7-b097-413c-bdd1-c1791f235546" released by "delete_volume" :: held 1.810s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Created reservations ['321816a0-46ee-4d52-80bb-97295cd8a48b', '27378693-e2bf-4dcd-8105-f84244000cc9', '61bb2dd3-71b1-4867-8c9e-f15a00beb26d', '915c8b1e-afe8-4b2e-af1d-c7a869d968bd'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:39 devstack sudo[94757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:39 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:40 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.819s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:40 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Deleted volume successfully.
Jul 07 22:39:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61c13e51-56b4-4fa9-96a3-539debb1d37d tempest-VolumesServicesTestJSON-877063600 None] Lock "cinder-da77ded7-b097-413c-bdd1-c1791f235546-delete_volume" released by "delete_volume" :: held 2.994s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:47 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:39:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Flow 'volume_create_manager' (6ccb419d-2bda-44af-af53-f06ab16fba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6d0cb1-857c-4d9e-855f-0fa7902991b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c6d0cb1-857c-4d9e-855f-0fa7902991b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1529352413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8fe298-58b9-4b2c-817d-6d281b9e94da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60c211ee0944af68ac0410be72a23fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:48Z,use_quota=True,user_id='feffa1c21bcb4adca757450318506cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73036761-2de2-47e9-9f10-14ea9a42d44c),volume_type_id=73036761-2de2-47e9-9f10-14ea9a42d44c)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ffe06f-2298-4666-9a31-4c8e54f82b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ffe06f-2298-4666-9a31-4c8e54f82b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a01074-ea97-4330-9db2-6d30076bc859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58a01074-ea97-4330-9db2-6d30076bc859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd8fe298-58b9-4b2c-817d-6d281b9e94da', 'volume_name': 'volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41338514-61ad-4562-9538-2df0d29743bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41338514-61ad-4562-9538-2df0d29743bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c3973c-67d1-4513-bc63-1b8a635a8c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Volume dd8fe298-58b9-4b2c-817d-6d281b9e94da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da', 'volume_size': 1}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1529352413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd8fe298-58b9-4b2c-817d-6d281b9e94da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60c211ee0944af68ac0410be72a23fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:39:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:39:48Z,use_quota=True,user_id='feffa1c21bcb4adca757450318506cc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(73036761-2de2-47e9-9f10-14ea9a42d44c),volume_type_id=73036761-2de2-47e9-9f10-14ea9a42d44c)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Creating volume dd8fe298-58b9-4b2c-817d-6d281b9e94da {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:39:48 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:39:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:48 devstack sudo[94918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da 1073741824
Jul 07 22:39:48 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:50 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da 1073741824" returned: 0 in 1.885s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:50 devstack sudo[94937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da
Jul 07 22:39:50 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:51 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da" returned: 0 in 1.261s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] <== create_volume: return (3300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.306s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c3973c-67d1-4513-bc63-1b8a635a8c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b52481-6010-496a-a0f9-2e5ccd303c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:39:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Volume volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da (dd8fe298-58b9-4b2c-817d-6d281b9e94da): created successfully
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9b52481-6010-496a-a0f9-2e5ccd303c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:39:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Flow 'volume_create_manager' (6ccb419d-2bda-44af-af53-f06ab16fba90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:39:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9f87320d-c126-42bb-93cd-121c93b0db0c tempest-VolumeTypesAccessTest-298048416 None] Created volume successfully.
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Acquiring lock "cinder-dd8fe298-58b9-4b2c-817d-6d281b9e94da-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "cinder-dd8fe298-58b9-4b2c-817d-6d281b9e94da-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Acquiring lock "cinder-quobyte-dd8fe298-58b9-4b2c-817d-6d281b9e94da" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "cinder-quobyte-dd8fe298-58b9-4b2c-817d-6d281b9e94da" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5afbe-5b42-42e4-92a6-f8774b45d1dd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:39:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:53 devstack sudo[94978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da
Jul 07 22:39:53 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:54 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da" returned: 0 in 1.365s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:54 devstack sudo[94994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da
Jul 07 22:39:54 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:55 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-dd8fe298-58b9-4b2c-817d-6d281b9e94da" returned: 0 in 1.219s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "cinder-quobyte-dd8fe298-58b9-4b2c-817d-6d281b9e94da" released by "delete_volume" :: held 2.657s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:39:55 devstack cinder-volume[88152]: WARNING cinder.quota [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1591162119 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1591162119, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:55 devstack cinder-volume[88152]: WARNING cinder.quota [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1591162119 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1591162119, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Created reservations ['94e586d5-e057-4594-9377-41b69d356c63', 'f72d3a0f-dea6-488a-b52a-af555bd237de', '72920e11-a238-4376-b6e8-b877fd5ae9ef', 'ff1f616c-c826-403e-8818-bf645dfd63f0'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:39:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:39:55 devstack sudo[95005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:39:55 devstack sudo[95005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:39:56 devstack sudo[95005]: pam_unix(sudo:session): session closed for user root
Jul 07 22:39:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.219s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:39:56 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:39:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Deleted volume successfully.
Jul 07 22:39:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-620bf9c8-953c-4d72-9e28-c48984e47ae2 tempest-VolumeTypesAccessTest-298048416 None] Lock "cinder-dd8fe298-58b9-4b2c-817d-6d281b9e94da-delete_volume" released by "delete_volume" :: held 4.263s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Flow 'volume_create_manager' (6f5f80ed-8fb9-4f4a-b8f6-6876db30d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ec4c6c-621a-4263-831b-0c4aea90aeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70ec4c6c-621a-4263-831b-0c4aea90aeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998504466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a24112-ba2f-4c5f-ba2d-0f959d13f6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e493c36dd5245b295e84c770ece3ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:02Z,use_quota=True,user_id='e106522a1cff417b83e1ad3a1d26ca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299f444a-2d68-42ba-af86-d220332b7b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299f444a-2d68-42ba-af86-d220332b7b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e545651-24ac-4cf6-8545-1d7813c46879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:02 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e545651-24ac-4cf6-8545-1d7813c46879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '19a24112-ba2f-4c5f-ba2d-0f959d13f6f5', 'volume_name': 'volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7447cb00>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a0bfd1-2023-4b5b-a009-9af59100a7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a0bfd1-2023-4b5b-a009-9af59100a7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1972e44-a669-4c37-a4fc-8c9abb0aa96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7447cb00>}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Trying to clone 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:40:03 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6bf37c-ee7d-4b22-8132-4ebb217ce593]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:04 devstack sudo[95060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD
Jul 07 22:40:04 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:04 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:04 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a is fetched for user e106522a1cff417b83e1ad3a1d26ca56. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:40:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c91f2e5-2dc5-4b22-9030-b62044118a75]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:04 devstack sudo[95076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD
Jul 07 22:40:04 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:05 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-998504466',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a24112-ba2f-4c5f-ba2d-0f959d13f6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e493c36dd5245b295e84c770ece3ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:02Z,use_quota=True,user_id='e106522a1cff417b83e1ad3a1d26ca56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Creating volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:05 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:05 devstack sudo[95082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1073741824
Jul 07 22:40:05 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:06 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1073741824" returned: 0 in 1.080s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:06 devstack sudo[95089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:06 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:07 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 0 in 0.779s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=68,cinder:SELECT=45,cinder:INSERT=12,cinder:DELETE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=60,cinder:SELECT=53,cinder:DELETE=4,cinder:INSERT=15 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Attempting download of 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dfd9e6-e4d2-4890-91b3-f496bd5fe985]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:07 devstack sudo[95092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3
Jul 07 22:40:07 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:08 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:08 devstack sudo[95096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3
Jul 07 22:40:08 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:09 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3" returned: 1 in 0.886s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_l7c9x1n3' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:40:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c8e4dc-1127-4fe3-ab1f-d20282116c62]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:09 devstack sudo[95100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD
Jul 07 22:40:09 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:10 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:10 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] 3d79ec3d-7feb-4185-b960-5d4caffe8b9a was qcow2, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:40:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:10 devstack sudo[95105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:10 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (8bc0eb1b-da2c-454b-9725-1d288c9eb8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35716b78-1103-4f0c-bceb-03dcbf7c027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35716b78-1103-4f0c-bceb-03dcbf7c027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-106655757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85158f16-7826-463f-a9e4-9e70815d43ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:12Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc345c5-2a4c-468e-bdc3-54685aa9071e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc345c5-2a4c-468e-bdc3-54685aa9071e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ca0269-23b7-474a-81de-c09ea0db4eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28ca0269-23b7-474a-81de-c09ea0db4eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85158f16-7826-463f-a9e4-9e70815d43ff', 'volume_name': 'volume-85158f16-7826-463f-a9e4-9e70815d43ff', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3151e-4fbb-4f16-a0c1-2d0cce59e3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a3151e-4fbb-4f16-a0c1-2d0cce59e3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3b511f-39dc-46c3-a8bb-e15210bdef5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Volume 85158f16-7826-463f-a9e4-9e70815d43ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85158f16-7826-463f-a9e4-9e70815d43ff', 'volume_size': 1}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-106655757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85158f16-7826-463f-a9e4-9e70815d43ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:12Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Creating volume 85158f16-7826-463f-a9e4-9e70815d43ff {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:12 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:12 devstack sudo[95120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff 1073741824
Jul 07 22:40:12 devstack sudo[95120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:12 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 0 in 2.678s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_jul7doxvdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:40:12 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Converted 112.00 MB image at 41.80 MB/s
Jul 07 22:40:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:12 devstack sudo[95122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1G
Jul 07 22:40:12 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:13 devstack sudo[95120]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff 1073741824" returned: 0 in 1.296s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:13 devstack sudo[95133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff
Jul 07 22:40:13 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:13 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 1G" returned: 0 in 1.016s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9a02bd-ff6e-4d28-a402-167930381771]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:14 devstack sudo[95136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:14 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:14 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] <== create_volume: return (2164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.167s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb3b511f-39dc-46c3-a8bb-e15210bdef5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85158f16-7826-463f-a9e4-9e70815d43ff', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff730ace-6eb1-4190-b3eb-eac9f003396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:14 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Volume volume-85158f16-7826-463f-a9e4-9e70815d43ff (85158f16-7826-463f-a9e4-9e70815d43ff): created successfully
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff730ace-6eb1-4190-b3eb-eac9f003396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (8bc0eb1b-da2c-454b-9725-1d288c9eb8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8fd2220f-8007-4ece-bc11-2e8cbe75e24f tempest-AttachVolumeNegativeTest-1688201570 None] Created volume successfully.
Jul 07 22:40:15 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 0 in 1.059s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:15 devstack sudo[95147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:15 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:16 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 1 in 1.278s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Downloaded image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a for user e106522a1cff417b83e1ad3a1d26ca56 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Marking volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Copying metadata from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a to 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Creating volume glance metadata for volume 19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 backed by image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1972e44-a669-4c37-a4fc-8c9abb0aa96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7447cb00>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689f25c-d27c-449e-9b3c-f67013c22ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:16 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Volume volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 (19a24112-ba2f-4c5f-ba2d-0f959d13f6f5): created successfully
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2689f25c-d27c-449e-9b3c-f67013c22ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Flow 'volume_create_manager' (6f5f80ed-8fb9-4f4a-b8f6-6876db30d064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-aed49def-afcc-4167-af72-17a14b96a55c tempest-VolumesImageMetadata-1926847060 None] Created volume successfully.
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Acquiring lock "cinder-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "cinder-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Acquiring lock "cinder-quobyte-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "cinder-quobyte-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a219fc8e-d711-4f3d-8ef2-5399beb24e0d]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:18 devstack sudo[95177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:18 devstack sudo[95177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcab4dde-8172-4695-8152-9ff169a3d47f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:19 devstack sudo[95177]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 0 in 1.033s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:19 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff
Jul 07 22:40:19 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (444d12a1-d05d-4354-a071-b59a30daed9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7488a8c9-e365-42cf-8283-4ca72e1f4460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7488a8c9-e365-42cf-8283-4ca72e1f4460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-763520741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c57665-94c8-4280-9834-c549b2ee81b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:19Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003c368-652a-4251-982c-e67d8a54fda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:19 devstack sudo[95190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:19 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003c368-652a-4251-982c-e67d8a54fda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f91b92f-0e1b-4b53-a351-c7c435b11624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f91b92f-0e1b-4b53-a351-c7c435b11624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c57665-94c8-4280-9834-c549b2ee81b3', 'volume_name': 'volume-a5c57665-94c8-4280-9834-c549b2ee81b3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc655ad6-c9a0-4bee-a759-40b2d5ee816e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc655ad6-c9a0-4bee-a759-40b2d5ee816e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdbc48f-9d72-4f2e-a03d-019666a9389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:19 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Volume a5c57665-94c8-4280-9834-c549b2ee81b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c57665-94c8-4280-9834-c549b2ee81b3', 'volume_size': 1}
Jul 07 22:40:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:20 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff" returned: 0 in 0.876s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:20 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-763520741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c57665-94c8-4280-9834-c549b2ee81b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:19Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Creating volume a5c57665-94c8-4280-9834-c549b2ee81b3 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:20 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 1 in 0.836s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:20 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 1073741824
Jul 07 22:40:20 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:20 devstack sudo[95201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5
Jul 07 22:40:20 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-85158f16-7826-463f-a9e4-9e70815d43ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7394d035-f01b-4c2c-96c2-b7b1690d1a69', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:40:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-d79688a3-9f23-4af2-a2fd-0ca9de13f95f req-f5878367-3310-4382-a82d-5c30e122d981 tempest-AttachVolumeNegativeTest-1688201570 None] attachment_update completed successfully.
Jul 07 22:40:21 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" returned: 0 in 0.908s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "cinder-quobyte-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5" released by "delete_volume" :: held 2.868s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Created reservations ['aa729d09-1321-455e-8563-c6e134e51261', '3611b10b-2b6f-4ac3-a7da-f60ed11019ea', 'f580fd2c-ccbf-44e8-85f1-1daac7721373', 'd72489c0-0635-426e-8bfd-8a23d44c5c72'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:21 devstack sudo[95276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:21 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:21 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 1073741824" returned: 0 in 1.135s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:21 devstack sudo[95278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3
Jul 07 22:40:21 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:22 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.947s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Deleted volume successfully.
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-48da1a79-3e80-4981-a188-d3bd2979a616 tempest-VolumesImageMetadata-1926847060 None] Lock "cinder-19a24112-ba2f-4c5f-ba2d-0f959d13f6f5-delete_volume" released by "delete_volume" :: held 4.093s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:22 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3" returned: 0 in 1.077s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] <== create_volume: return (2267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cdbc48f-9d72-4f2e-a03d-019666a9389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c57665-94c8-4280-9834-c549b2ee81b3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f960e7-9e0a-4bfd-a899-57003449ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Volume volume-a5c57665-94c8-4280-9834-c549b2ee81b3 (a5c57665-94c8-4280-9834-c549b2ee81b3): created successfully
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f960e7-9e0a-4bfd-a899-57003449ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (444d12a1-d05d-4354-a071-b59a30daed9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1521c969-7eb9-4b93-b235-9b8147deb579 tempest-VolumesListAdminTestJSON-532963157 None] Created volume successfully.
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (bce228c5-d90f-46d5-a146-399afcf7dd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c37a4-fca5-43c0-9b02-fb9a20653225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9c37a4-fca5-43c0-9b02-fb9a20653225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917946307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99460f5d-0719-448e-a76a-eb1ed89afd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:24Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e69174-0c78-452b-8828-3f6f2b2c0e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e69174-0c78-452b-8828-3f6f2b2c0e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8101182-018a-48b3-ad84-8e667eab3e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8101182-018a-48b3-ad84-8e667eab3e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99460f5d-0719-448e-a76a-eb1ed89afd67', 'volume_name': 'volume-99460f5d-0719-448e-a76a-eb1ed89afd67', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b5cb0f-cd9f-4256-be54-3ec6452b0b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b5cb0f-cd9f-4256-be54-3ec6452b0b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d228adfb-694f-4cf0-b090-886f873a46f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Volume 99460f5d-0719-448e-a76a-eb1ed89afd67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99460f5d-0719-448e-a76a-eb1ed89afd67', 'volume_size': 1}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-917946307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99460f5d-0719-448e-a76a-eb1ed89afd67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:24Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Creating volume 99460f5d-0719-448e-a76a-eb1ed89afd67 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:23 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:23 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 1073741824
Jul 07 22:40:23 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:25 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 1073741824" returned: 0 in 1.116s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:25 devstack sudo[95604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67
Jul 07 22:40:25 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:26 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67" returned: 0 in 0.937s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d228adfb-694f-4cf0-b090-886f873a46f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99460f5d-0719-448e-a76a-eb1ed89afd67', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15215de6-e406-439f-91a2-5a8cb461eacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Volume volume-99460f5d-0719-448e-a76a-eb1ed89afd67 (99460f5d-0719-448e-a76a-eb1ed89afd67): created successfully
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15215de6-e406-439f-91a2-5a8cb461eacb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (bce228c5-d90f-46d5-a146-399afcf7dd28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (a1824065-058a-494d-96de-a16a679fcd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222a6ac-dcb8-44f7-946d-4f5710f1545d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6b84a788-1d5b-4fdf-8ad8-367bb29d864b tempest-VolumesListAdminTestJSON-532963157 None] Created volume successfully.
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5222a6ac-dcb8-44f7-946d-4f5710f1545d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-441387148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97239cb6-c540-473d-912c-44db8be623f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d699312bdcea464192357091cd8ac9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:26Z,use_quota=True,user_id='8a05df724f7f4d72ab60d1c2014d9855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d58ad4-0c4d-4886-9353-75caa222a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9d58ad4-0c4d-4886-9353-75caa222a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8115a7ad-4147-4115-a6f5-2dbf25c691f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8115a7ad-4147-4115-a6f5-2dbf25c691f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97239cb6-c540-473d-912c-44db8be623f0', 'volume_name': 'volume-97239cb6-c540-473d-912c-44db8be623f0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab175e0-2f02-4be6-90ac-9740770eb43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aab175e0-2f02-4be6-90ac-9740770eb43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8388dc-8554-413d-beb9-d87f4cbb2e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Volume 97239cb6-c540-473d-912c-44db8be623f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97239cb6-c540-473d-912c-44db8be623f0', 'volume_size': 1}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-441387148',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97239cb6-c540-473d-912c-44db8be623f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d699312bdcea464192357091cd8ac9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:26Z,use_quota=True,user_id='8a05df724f7f4d72ab60d1c2014d9855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Creating volume 97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:26 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:26 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 1073741824
Jul 07 22:40:26 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:27 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 1073741824" returned: 0 in 1.126s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:27 devstack sudo[95620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:40:27 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (4baa30db-bef2-4f11-8b0a-2f20da870c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7c284e-89c0-437b-985f-ab81b91b9670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7c284e-89c0-437b-985f-ab81b91b9670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-953656644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6b923-1469-40a1-936a-5ce517e0c04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:28Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fe7b28-f09f-4880-94df-664d4e196c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31fe7b28-f09f-4880-94df-664d4e196c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6733da9-2b69-40b4-8250-ece59f792007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6733da9-2b69-40b4-8250-ece59f792007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d6b923-1469-40a1-936a-5ce517e0c04c', 'volume_name': 'volume-e1d6b923-1469-40a1-936a-5ce517e0c04c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d3e724-2bd8-4b05-8faa-163d7816626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d3e724-2bd8-4b05-8faa-163d7816626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd2c460-74d0-4b9c-92ec-73eaaf154297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Volume e1d6b923-1469-40a1-936a-5ce517e0c04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d6b923-1469-40a1-936a-5ce517e0c04c', 'volume_size': 1}
Jul 07 22:40:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:28 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 0.878s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.576s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-953656644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d6b923-1469-40a1-936a-5ce517e0c04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a4c91b5171d4130a243970ee1021322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:28Z,use_quota=True,user_id='eebb6702045d4776b6e04fe7536f384e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Creating volume e1d6b923-1469-40a1-936a-5ce517e0c04c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:28 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:28 devstack sudo[95624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c 1073741824
Jul 07 22:40:28 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a8388dc-8554-413d-beb9-d87f4cbb2e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97239cb6-c540-473d-912c-44db8be623f0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6548a4-2370-4270-a8a9-df58adbd75c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Volume volume-97239cb6-c540-473d-912c-44db8be623f0 (97239cb6-c540-473d-912c-44db8be623f0): created successfully
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6548a4-2370-4270-a8a9-df58adbd75c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (a1824065-058a-494d-96de-a16a679fcd87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fffb73e8-e4ca-42e4-86b4-810143423d86 tempest-VolumesDeleteCascade-1505101235 None] Created volume successfully.
Jul 07 22:40:29 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c 1073741824" returned: 0 in 1.038s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:29 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c
Jul 07 22:40:29 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:30 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c" returned: 0 in 0.770s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.697s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cd2c460-74d0-4b9c-92ec-73eaaf154297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d6b923-1469-40a1-936a-5ce517e0c04c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176ae8f9-c468-489e-8a9d-b0d87aa3e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Creating offline snapshot 53c4d69b-add9-4521-aa97-f33bdc1b3c8b of volume 97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:40:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Volume volume-e1d6b923-1469-40a1-936a-5ce517e0c04c (e1d6b923-1469-40a1-936a-5ce517e0c04c): created successfully
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176ae8f9-c468-489e-8a9d-b0d87aa3e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Flow 'volume_create_manager' (4baa30db-bef2-4f11-8b0a-2f20da870c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f389cc0-3a7c-40fd-93dd-40cebef45c98]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3a28f58a-1630-4ebf-a2fd-cdb3c9b51ba5 tempest-VolumesListAdminTestJSON-532963157 None] Created volume successfully.
Jul 07 22:40:30 devstack sudo[95636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:40:30 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:31 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 0.919s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:31 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b 1G
Jul 07 22:40:31 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Flow 'volume_create_manager' (ffde2c87-1c22-4390-bf88-414161289d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e56226-1c70-4de3-baea-5807b26fb3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e56226-1c70-4de3-baea-5807b26fb3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae742426aee44269948a37002947040c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:32Z,use_quota=True,user_id='2b2495d96f8c4d3e816fc7ef32da58ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ef0b8a-9c60-4110-a962-c6295b2b8369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ef0b8a-9c60-4110-a962-c6295b2b8369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066d764d-7299-4765-b4a5-11e6d2c80ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066d764d-7299-4765-b4a5-11e6d2c80ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1', 'volume_name': 'volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08088291-0b31-48a2-a7ba-452c316be63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08088291-0b31-48a2-a7ba-452c316be63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e09389-a3c8-46b7-890e-484c3a816f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Volume 9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1', 'volume_size': 1}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:32 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b 1G" returned: 0 in 1.137s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:32 devstack sudo[95649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:32 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:33 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 0.899s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:33 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b is being set with open permissions: ugo+rw
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:33 devstack sudo[95654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:33 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:33 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:33 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:34 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 0.790s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:34 devstack sudo[95666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info
Jul 07 22:40:34 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:34 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.026s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:40:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:40:35 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info" returned: 0 in 0.960s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:35 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info is being set with open permissions: ugo+rw
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:35 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info
Jul 07 22:40:35 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:35 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.info" returned: 0 in 0.799s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.675s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.819s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae742426aee44269948a37002947040c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:32Z,use_quota=True,user_id='2b2495d96f8c4d3e816fc7ef32da58ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Creating volume 9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:35 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:35 devstack sudo[95684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 1073741824
Jul 07 22:40:35 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-929362d1-87b1-45ab-800f-4ea336136db2 tempest-VolumesDeleteCascade-1505101235 None] Create snapshot completed successfully
Jul 07 22:40:37 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 1073741824" returned: 0 in 1.082s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:37 devstack sudo[95704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1
Jul 07 22:40:37 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:37 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" returned: 0 in 0.732s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.886s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.660s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Creating offline snapshot eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 of volume 97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e09389-a3c8-46b7-890e-484c3a816f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d33a39a-8a90-44a1-a2e2-e2ff988833d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d840838-36fe-4db5-b11b-6e51245530e5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Volume volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 (9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1): created successfully
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d33a39a-8a90-44a1-a2e2-e2ff988833d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Flow 'volume_create_manager' (ffde2c87-1c22-4390-bf88-414161289d05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-53e868ab-7fcb-43f7-88bd-983f142adef2 tempest-VolumesListAdminTestJSON-216871509 None] Created volume successfully.
Jul 07 22:40:38 devstack sudo[95716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:38 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Acquiring lock "cinder-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "cinder-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Acquiring lock "cinder-quobyte-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "cinder-quobyte-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e13d75-b348-4437-ad11-2d2d05705d86]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-e1d6b923-1469-40a1-936a-5ce517e0c04c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:38 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 1.067s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97239cb6-c540-473d-912c-44db8be623f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-e1d6b923-1469-40a1-936a-5ce517e0c04c-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:39 devstack sudo[95754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 1G
Jul 07 22:40:39 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:39 devstack sudo[95751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1
Jul 07 22:40:39 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-quobyte-e1d6b923-1469-40a1-936a-5ce517e0c04c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-e1d6b923-1469-40a1-936a-5ce517e0c04c" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f20d38-e87d-4a25-8e4b-5e8815c2091a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:39 devstack sudo[95763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c
Jul 07 22:40:39 devstack sudo[95763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:40 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" returned: 0 in 1.239s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:40 devstack sudo[95783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1
Jul 07 22:40:40 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:40 devstack sudo[95763]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c" returned: 0 in 1.228s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:40 devstack sudo[95807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c
Jul 07 22:40:40 devstack sudo[95807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:40 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 1G" returned: 0 in 1.534s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:40 devstack sudo[95809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:40:40 devstack sudo[95809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:41 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" returned: 0 in 1.152s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "cinder-quobyte-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1" released by "delete_volume" :: held 2.476s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Created reservations ['22af682a-a726-4ed0-b230-f92c272b858d', '130a2205-6fb2-41d7-9db5-ed771b7897a1', '62f7a792-d0a1-4b54-bf87-c94b6a130273', '474830c6-a990-4150-8567-ae94d3557747'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:41 devstack sudo[95856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:41 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:41 devstack sudo[95807]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e1d6b923-1469-40a1-936a-5ce517e0c04c" returned: 0 in 1.246s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-e1d6b923-1469-40a1-936a-5ce517e0c04c" released by "delete_volume" :: held 2.574s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Created reservations ['00afcf25-019f-4136-a905-58ac89e0cbd3', 'a8e24d20-fbab-4c62-a87c-39b1d1b2319f', 'ec808530-3cb9-4cd6-a4cc-4bc7724e9494', 'bba44b18-c40b-4cb3-be9f-236afdc8bfbc'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:41 devstack sudo[95863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:41 devstack sudo[95863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:42 devstack sudo[95809]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 1.606s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:42 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 is being set with open permissions: ugo+rw
Jul 07 22:40:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:42 devstack sudo[95865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:40:42 devstack sudo[95865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-99460f5d-0719-448e-a76a-eb1ed89afd67-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-99460f5d-0719-448e-a76a-eb1ed89afd67-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-quobyte-99460f5d-0719-448e-a76a-eb1ed89afd67" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-99460f5d-0719-448e-a76a-eb1ed89afd67" acquired by "delete_volume" :: waited 0.079s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9313c05-7788-45d6-92dc-8a078ea6b743]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:43 devstack sudo[95887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67
Jul 07 22:40:43 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:43 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.163s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Deleted volume successfully.
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2da314a3-d75b-4e2d-b3cf-c95477cca512 tempest-VolumesListAdminTestJSON-216871509 None] Lock "cinder-9db8bc18-1754-4edf-8bc7-e0dbf88fe0e1-delete_volume" released by "delete_volume" :: held 5.125s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:43 devstack sudo[95863]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.002s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Deleted volume successfully.
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5536dd7-48d1-4f70-b7ce-a6fd7c36e0b7 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-e1d6b923-1469-40a1-936a-5ce517e0c04c-delete_volume" released by "delete_volume" :: held 4.939s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:43 devstack sudo[95865]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 1.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.192s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-175bafae-29d9-4c7f-bd26-d12918212912 tempest-VolumesDeleteCascade-1505101235 None] Create snapshot completed successfully
Jul 07 22:40:44 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67" returned: 0 in 1.414s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:44 devstack sudo[95897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67
Jul 07 22:40:44 devstack sudo[95897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-97239cb6-c540-473d-912c-44db8be623f0-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-97239cb6-c540-473d-912c-44db8be623f0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Performing cascade delete. {{(pid=88152) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-53c4d69b-add9-4521-aa97-f33bdc1b3c8b-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-53c4d69b-add9-4521-aa97-f33bdc1b3c8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-53c4d69b-add9-4521-aa97-f33bdc1b3c8b" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-53c4d69b-add9-4521-aa97-f33bdc1b3c8b" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Deleting offline snapshot 53c4d69b-add9-4521-aa97-f33bdc1b3c8b of volume 97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] snapshot_file for this snap is: volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e97596d-e5c1-4a62-bb98-ab98eae8252e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:45 devstack sudo[95897]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99460f5d-0719-448e-a76a-eb1ed89afd67" returned: 0 in 1.182s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:45 devstack sudo[95901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:45 devstack sudo[95901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-99460f5d-0719-448e-a76a-eb1ed89afd67" released by "delete_volume" :: held 2.708s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Created reservations ['276145de-66e0-4a54-91aa-08e806248a6f', '3d790c84-7b83-43a8-8f6b-05e13631a70a', 'fb9c5bac-3647-4ff4-9775-0dba552249f7', '379d146f-a3c7-4b38-bebb-e6e8975a3cc8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:46 devstack sudo[95904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:46 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-a5c57665-94c8-4280-9834-c549b2ee81b3-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-a5c57665-94c8-4280-9834-c549b2ee81b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "cinder-quobyte-a5c57665-94c8-4280-9834-c549b2ee81b3" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-a5c57665-94c8-4280-9834-c549b2ee81b3" acquired by "delete_volume" :: waited 0.077s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e757515-1064-4053-9007-6dd9882b9cde]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:47 devstack sudo[95906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3
Jul 07 22:40:47 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:47 devstack sudo[95901]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 2.286s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97239cb6-c540-473d-912c-44db8be623f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6288a28a-6cb8-4862-a56b-f67c8007c5ce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:48 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.889s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:48 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Deleted volume successfully.
Jul 07 22:40:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-69f0a046-a05a-4a0c-8df2-fe0493771605 tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-99460f5d-0719-448e-a76a-eb1ed89afd67-delete_volume" released by "delete_volume" :: held 5.351s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:48 devstack sudo[95913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:40:48 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:49 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3" returned: 0 in 2.042s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:49 devstack sudo[95918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3
Jul 07 22:40:49 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:49 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 2.057s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[066586ae-49d8-4c46-8a91-be360b89694f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:50 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:40:50 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:50 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a5c57665-94c8-4280-9834-c549b2ee81b3" returned: 0 in 1.441s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-quobyte-a5c57665-94c8-4280-9834-c549b2ee81b3" released by "delete_volume" :: held 3.623s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Created reservations ['05fdc1f5-efbf-4a6f-8184-76ee6331fe3a', 'a66fccdb-cc0d-443e-a394-5d485fc85731', '6efb222e-6846-490b-b8e0-47bcac25a39f', '75cb3fb4-0ad0-4262-bddb-16868c3effd6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:51 devstack sudo[95932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:40:51 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:51 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 1.221s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97239cb6-c540-473d-912c-44db8be623f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f776e77b-b259-4af0-a39b-962cba3b8024]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:51 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:51 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:52 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.204s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:40:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Deleted volume successfully.
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bd00f42a-ee36-4544-b209-6f3b9b26e6fc tempest-VolumesListAdminTestJSON-532963157 None] Lock "cinder-a5c57665-94c8-4280-9834-c549b2ee81b3-delete_volume" released by "delete_volume" :: held 5.470s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:52 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 1.438s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97239cb6-c540-473d-912c-44db8be623f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc0abc5-1bd7-4013-ad38-d2b1a5bd7171]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:52 devstack sudo[95940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:40:52 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:53 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 1.133s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:53 devstack sudo[95969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:53 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:55 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 1.262s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:55 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b
Jul 07 22:40:55 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:56 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.53c4d69b-add9-4521-aa97-f33bdc1b3c8b" returned: 0 in 1.000s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 -F qcow2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:56 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 -F qcow2
Jul 07 22:40:56 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:57 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97239cb6-c540-473d-912c-44db8be623f0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 -F qcow2" returned: 0 in 1.133s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-53c4d69b-add9-4521-aa97-f33bdc1b3c8b" released by "_delete_snapshot" :: held 11.892s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" released by "delete_snapshot" :: held 11.962s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['bab7b32f-544d-43db-9a50-fa5de690b5c3', 'fe94a4a8-691f-48d3-8e75-c7738d1d9366', '18359376-9526-446e-a02f-3fcebd8d418a', '89a3999f-5671-4542-bf69-e3373a97a9c7'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:40:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Delete snapshot completed successfully.
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-53c4d69b-add9-4521-aa97-f33bdc1b3c8b-delete_snapshot" released by "delete_snapshot" :: held 12.234s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Deleting offline snapshot eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 of volume 97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] snapshot_file for this snap is: volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b35bb9-5d8c-4273-8a05-ecddaae3aa50]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:57 devstack sudo[96042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:40:57 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:58 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 0.957s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97239cb6-c540-473d-912c-44db8be623f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:40:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5204b74f-a450-4cfd-b4e0-f1d03aa33765]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:40:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:58 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:40:58 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Flow 'volume_create_manager' (e08c9c6f-7c1f-4f78-9a8a-42820ec4c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2328b7d5-3ba0-4d3d-b2da-2cdc34872ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2328b7d5-3ba0-4d3d-b2da-2cdc34872ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227517692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13380547-50fc-4f51-974e-f4c6fd6a3161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc28505f16f64fa38350282a3545a8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:59Z,use_quota=True,user_id='837aa7f062b24d478b2522a67ebf3b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126ae1ff-783a-4505-a105-0b7b676a4f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126ae1ff-783a-4505-a105-0b7b676a4f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7c088-ab0c-4cbf-b84e-f05e81db3203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb7c088-ab0c-4cbf-b84e-f05e81db3203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13380547-50fc-4f51-974e-f4c6fd6a3161', 'volume_name': 'volume-13380547-50fc-4f51-974e-f4c6fd6a3161', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e84e689-7ea4-4436-a422-e0eddfb434a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e84e689-7ea4-4436-a422-e0eddfb434a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1550a1e-9b70-42d7-ab10-cb68f4dfc82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:40:59 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Volume 13380547-50fc-4f51-974e-f4c6fd6a3161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13380547-50fc-4f51-974e-f4c6fd6a3161', 'volume_size': 1}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-227517692',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13380547-50fc-4f51-974e-f4c6fd6a3161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc28505f16f64fa38350282a3545a8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:40:59Z,use_quota=True,user_id='837aa7f062b24d478b2522a67ebf3b8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Creating volume 13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:40:59 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:59 devstack sudo[96070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 1073741824
Jul 07 22:40:59 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:40:59 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 0.855s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:40:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:40:59 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:40:59 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:00 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 1073741824" returned: 0 in 0.863s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:00 devstack sudo[96083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161
Jul 07 22:41:00 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:00 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 0.772s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:00 devstack sudo[96086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828
Jul 07 22:41:00 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:00 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1550a1e-9b70-42d7-ab10-cb68f4dfc82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13380547-50fc-4f51-974e-f4c6fd6a3161', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f76842-c2a9-4b65-8543-2e2b8e62e45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:00 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Volume volume-13380547-50fc-4f51-974e-f4c6fd6a3161 (13380547-50fc-4f51-974e-f4c6fd6a3161): created successfully
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f76842-c2a9-4b65-8543-2e2b8e62e45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Flow 'volume_create_manager' (e08c9c6f-7c1f-4f78-9a8a-42820ec4c871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ee0754e2-e758-4d09-bf33-a01b17822567 tempest-SnapshotMetadataTestJSON-135755187 None] Created volume successfully.
Jul 07 22:41:00 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0.eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" returned: 0 in 0.680s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828" released by "_delete_snapshot" :: held 3.388s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" released by "delete_snapshot" :: held 3.419s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['0585cd69-8ea6-4f8f-8d67-5cc17982f9fa', '4b344b7d-bf3b-4bad-a750-b888e603cc29', '6cda7b09-b7c1-4e8c-9e49-708811096095', 'e35ffa22-7433-4f99-a832-ac23d175af12'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Delete snapshot completed successfully.
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-eca4cf72-7e1d-4f5a-8e3b-b44c552c9828-delete_snapshot" released by "delete_snapshot" :: held 3.579s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Snapshots deleted, issuing volume delete {{(pid=88152) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcd5722-051e-4009-b44f-fb232eed02b4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:01 devstack sudo[96090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:41:01 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Creating offline snapshot 864c8da6-90b5-4cc1-87d5-ef8ec8a685cf of volume 13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc4c00-7a0e-44af-b946-75b8ece110c6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:01 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161
Jul 07 22:41:01 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:02 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 0.817s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:02 devstack sudo[96099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0
Jul 07 22:41:02 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:02 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161" returned: 0 in 0.754s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:02 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf 1G
Jul 07 22:41:02 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:02 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-97239cb6-c540-473d-912c-44db8be623f0" returned: 0 in 0.637s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-97239cb6-c540-473d-912c-44db8be623f0" released by "delete_volume" :: held 1.551s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['7c4afa50-42eb-4551-92cd-3b10b7e166de', '77fcea2a-9fca-4f48-ad10-a4374da16665', 'ec6e9c9b-ba3d-45f3-ba01-3cfdb285d7fa', 'c57be551-a7fb-484a-aeea-0f5a83eb34bb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:02 devstack sudo[96108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:02 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:03 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf 1G" returned: 0 in 0.943s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13380547-50fc-4f51-974e-f4c6fd6a3161 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:03 devstack sudo[96111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13380547-50fc-4f51-974e-f4c6fd6a3161 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf
Jul 07 22:41:03 devstack sudo[96111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:03 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.771s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Deleted volume successfully.
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-26341e5f-b70d-4b2e-bd21-3e70aaf6be7b tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-97239cb6-c540-473d-912c-44db8be623f0-delete_volume" released by "delete_volume" :: held 18.625s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:03 devstack sudo[96111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13380547-50fc-4f51-974e-f4c6fd6a3161 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" returned: 0 in 0.843s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:03 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf is being set with open permissions: ugo+rw
Jul 07 22:41:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:03 devstack sudo[96117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf
Jul 07 22:41:03 devstack sudo[96117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (dd6d5b59-0772-42b5-a142-fbd66aa883f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c36fe3f-6dd2-4033-8329-d1913dbdcd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c36fe3f-6dd2-4033-8329-d1913dbdcd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340163258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2f9dde-7b62-4f14-9730-8d5da358fde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d699312bdcea464192357091cd8ac9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:04Z,use_quota=True,user_id='8a05df724f7f4d72ab60d1c2014d9855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af2cc95-252d-4122-b6ba-9c5a80d53a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af2cc95-252d-4122-b6ba-9c5a80d53a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f529ef94-509f-4fd1-ac46-0b6926a66be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f529ef94-509f-4fd1-ac46-0b6926a66be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2f9dde-7b62-4f14-9730-8d5da358fde5', 'volume_name': 'volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e578ddda-b8cf-4265-8b2e-94caac6365e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e578ddda-b8cf-4265-8b2e-94caac6365e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b99833-d855-4b2f-bce1-488c8b3590f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Volume 4c2f9dde-7b62-4f14-9730-8d5da358fde5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5', 'volume_size': 1}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:04 devstack sudo[96117]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" returned: 0 in 0.739s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:04 devstack sudo[96120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info
Jul 07 22:41:04 devstack sudo[96120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:05 devstack sudo[96120]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:05 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info is being set with open permissions: ugo+rw
Jul 07 22:41:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:05 devstack sudo[96124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info
Jul 07 22:41:05 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:06 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.info" returned: 0 in 0.683s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.758s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1340163258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2f9dde-7b62-4f14-9730-8d5da358fde5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d699312bdcea464192357091cd8ac9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:04Z,use_quota=True,user_id='8a05df724f7f4d72ab60d1c2014d9855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Creating volume 4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:06 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:06 devstack sudo[96127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 1073741824
Jul 07 22:41:06 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-44484a79-f583-4346-be25-8236668f4626 tempest-SnapshotMetadataTestJSON-135755187 None] Create snapshot completed successfully
Jul 07 22:41:07 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 1073741824" returned: 0 in 1.098s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:07 devstack sudo[96134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:07 devstack sudo[96134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "cinder-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "cinder-quobyte-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Deleting offline snapshot 864c8da6-90b5-4cc1-87d5-ef8ec8a685cf of volume 13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] snapshot_file for this snap is: volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a24a319-d40f-459c-84dc-7094fe99f749]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=80,cinder:UPDATE=94,cinder:INSERT=20,cinder:DELETE=8 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:07 devstack sudo[96136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf
Jul 07 22:41:07 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=78,cinder:UPDATE=86,cinder:INSERT=34,cinder:DELETE=9 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:41:07 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (d86440be-be16-478d-ad50-6188e20722e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581d31a6-da16-48c1-b80e-36b7d50badb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (581d31a6-da16-48c1-b80e-36b7d50badb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1233832214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e418b-633e-427d-b2f9-e9b7cca0da27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:08Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1264815f-6146-43a1-8393-0c690a5bcfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1264815f-6146-43a1-8393-0c690a5bcfb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68290ff2-f4b3-4f7b-abbb-8cb0d06984b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68290ff2-f4b3-4f7b-abbb-8cb0d06984b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a44e418b-633e-427d-b2f9-e9b7cca0da27', 'volume_name': 'volume-a44e418b-633e-427d-b2f9-e9b7cca0da27', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1dcdc-d0b5-4e3f-8696-d1b65a8a4e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd1dcdc-d0b5-4e3f-8696-d1b65a8a4e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf34f961-81ae-41bc-a478-b3c851e82aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Volume a44e418b-633e-427d-b2f9-e9b7cca0da27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a44e418b-633e-427d-b2f9-e9b7cca0da27', 'volume_size': 1}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:08 devstack sudo[96134]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 0.872s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.041s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.093s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1233832214',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a44e418b-633e-427d-b2f9-e9b7cca0da27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:08Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Creating volume a44e418b-633e-427d-b2f9-e9b7cca0da27 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:08 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:08 devstack sudo[96139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 1073741824
Jul 07 22:41:08 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b99833-d855-4b2f-bce1-488c8b3590f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e2dad5-84ce-489c-98b3-18dc5529d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Volume volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 (4c2f9dde-7b62-4f14-9730-8d5da358fde5): created successfully
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e2dad5-84ce-489c-98b3-18dc5529d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (dd6d5b59-0772-42b5-a142-fbd66aa883f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7ccbae9c-3b69-407a-9bd5-dd7e4cdebf9c tempest-VolumesDeleteCascade-1505101235 None] Created volume successfully.
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:08 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" returned: 0 in 1.152s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13380547-50fc-4f51-974e-f4c6fd6a3161(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a60e4a-aa3d-420b-a448-d92c24710728]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:09 devstack sudo[96147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161
Jul 07 22:41:09 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:09 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 1073741824" returned: 0 in 1.162s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:09 devstack sudo[96151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27
Jul 07 22:41:09 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:09 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161" returned: 0 in 0.937s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:09 devstack sudo[96158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf
Jul 07 22:41:09 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:10 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.429s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf34f961-81ae-41bc-a478-b3c851e82aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a44e418b-633e-427d-b2f9-e9b7cca0da27', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677b60cc-250f-45f1-89e5-5b4db9912075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Creating offline snapshot 057ec841-098f-42ae-973c-5281cf5caf81 of volume 4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:41:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Volume volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 (a44e418b-633e-427d-b2f9-e9b7cca0da27): created successfully
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677b60cc-250f-45f1-89e5-5b4db9912075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (d86440be-be16-478d-ad50-6188e20722e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d23c9-242b-4cf1-b34e-91f3feabb6b8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:10 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5fb1e0e3-9f0b-4977-b424-d910ba565a59 tempest-AttachVolumeTestJSON-727612247 None] Created volume successfully.
Jul 07 22:41:10 devstack sudo[96161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:10 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:10 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" returned: 0 in 0.905s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:10 devstack sudo[96167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf
Jul 07 22:41:10 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:11 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 0.890s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:11 devstack sudo[96172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 1G
Jul 07 22:41:11 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:11 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161.864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" returned: 0 in 0.729s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf" released by "_delete_snapshot" :: held 3.866s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" released by "delete_snapshot" :: held 3.895s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Created reservations ['30697ec7-6f26-4bf3-89ae-08856728df48', '60dceb48-a6ac-4a94-82fc-008fc824c6e8', 'b42de616-92b7-4330-b93e-ee7e4b19e2ed', '4a8a83ed-9bc6-4153-a7b2-e78d2554f2fb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Delete snapshot completed successfully.
Jul 07 22:41:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5344cf25-31af-4326-8923-fb71a02353e5 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-864c8da6-90b5-4cc1-87d5-ef8ec8a685cf-delete_snapshot" released by "delete_snapshot" :: held 4.104s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "cinder-13380547-50fc-4f51-974e-f4c6fd6a3161-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-13380547-50fc-4f51-974e-f4c6fd6a3161-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:12 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 1G" returned: 0 in 1.027s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468a202-9d94-4a02-bfd6-7c3d39319844]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:12 devstack sudo[96188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:12 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:12 devstack sudo[96189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161
Jul 07 22:41:12 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:13 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 1.017s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:13 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 is being set with open permissions: ugo+rw
Jul 07 22:41:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:13 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:13 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:13 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161" returned: 0 in 1.257s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:13 devstack sudo[96220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161
Jul 07 22:41:13 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:14 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 0.922s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:14 devstack sudo[96227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info
Jul 07 22:41:14 devstack sudo[96227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:14 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13380547-50fc-4f51-974e-f4c6fd6a3161" returned: 0 in 0.790s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-quobyte-13380547-50fc-4f51-974e-f4c6fd6a3161" released by "delete_volume" :: held 2.142s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Created reservations ['bb2e8b9b-a78f-4ca5-87cc-e1f2dbb26741', '6e884da1-722e-45b8-9d3c-99be689e69ef', 'bf73989c-8a2e-42bd-96af-573b75dae966', '143353e9-d5d3-4934-b663-27cab5516876'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:14 devstack sudo[96237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:14 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:15 devstack sudo[96227]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info" returned: 0 in 0.949s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:15 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info is being set with open permissions: ugo+rw
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:15 devstack sudo[96241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info
Jul 07 22:41:15 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:15 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.764s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Deleted volume successfully.
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2ec028cc-c615-461c-8a60-24ada3941575 tempest-SnapshotMetadataTestJSON-135755187 None] Lock "cinder-13380547-50fc-4f51-974e-f4c6fd6a3161-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:15 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.info" returned: 0 in 0.756s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.733s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.184s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0c9fff8b-f02f-49e3-9133-aed1057a4b10 tempest-VolumesDeleteCascade-1505101235 None] Create snapshot completed successfully
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1cce4c-dbcf-4b6c-8b8a-19da3fb216da]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:16 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27
Jul 07 22:41:16 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (f273be38-1e04-4a17-a0d2-ff25651011e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e6acb5-1ea7-4147-980f-202ebd4bc7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e6acb5-1ea7-4147-980f-202ebd4bc7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1637977754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16355f7c-66f2-4299-8e91-1a1395f2b7a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d699312bdcea464192357091cd8ac9d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=057ec841-098f-42ae-973c-5281cf5caf81,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:17Z,use_quota=True,user_id='8a05df724f7f4d72ab60d1c2014d9855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e83c0c-929a-41c0-9d93-846b25872879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70e83c0c-929a-41c0-9d93-846b25872879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524fa88d-e717-49b2-b0f9-46113e69b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (524fa88d-e717-49b2-b0f9-46113e69b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16355f7c-66f2-4299-8e91-1a1395f2b7a1', 'volume_name': 'volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1', 'volume_size': 1, 'snapshot_id': '057ec841-098f-42ae-973c-5281cf5caf81'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea582f49-46a5-4aba-a8a9-cbe55528b861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea582f49-46a5-4aba-a8a9-cbe55528b861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca796c-018f-4dbc-ab9c-b3fedd32deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:16 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Volume 16355f7c-66f2-4299-8e91-1a1395f2b7a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1', 'volume_size': 1, 'snapshot_id': '057ec841-098f-42ae-973c-5281cf5caf81'}
Jul 07 22:41:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:17 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27" returned: 0 in 1.201s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.241s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.186s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81-16355f7c-66f2-4299-8e91-1a1395f2b7a1" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81-16355f7c-66f2-4299-8e91-1a1395f2b7a1" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Creating volume 16355f7c-66f2-4299-8e91-1a1395f2b7a1 from snapshot 057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] snapshot: 057ec841-098f-42ae-973c-5281cf5caf81, volume: 16355f7c-66f2-4299-8e91-1a1395f2b7a1,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-a44e418b-633e-427d-b2f9-e9b7cca0da27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e62239d1-d233-443c-b1cb-596b9a8e5d14', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[168eb844-518c-4d87-83b7-fac1eb89841e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-02f8f77b-f249-4482-b643-418419409d15 req-32d9f31d-2a5e-4eaa-89b9-c3c4262f8f1c tempest-AttachVolumeTestJSON-727612247 None] attachment_update completed successfully.
Jul 07 22:41:17 devstack sudo[96252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:17 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:18 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 0.921s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8fcc03-417a-4879-a615-9ca8b14b9435]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:18 devstack sudo[96258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:18 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:19 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 1.031s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:19 devstack sudo[96265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1
Jul 07 22:41:19 devstack sudo[96265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Flow 'volume_create_manager' (ea7a8381-830b-4faf-aab6-c80456c5a8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7a7ad-58b4-42f6-a993-73d9dd17d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04a7a7ad-58b4-42f6-a993-73d9dd17d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-984543035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677152f7-4873-43a6-a78d-8333917b9ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6b4e860d8b4e159141511c8a553c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:20Z,use_quota=True,user_id='d4d1433ccb1e444e82ca37c5006ab177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1051622f-00dd-4f05-8496-3a9b763f7738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1051622f-00dd-4f05-8496-3a9b763f7738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc84f43d-d596-4a9a-bd58-e66eb38a9c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc84f43d-d596-4a9a-bd58-e66eb38a9c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677152f7-4873-43a6-a78d-8333917b9ceb', 'volume_name': 'volume-677152f7-4873-43a6-a78d-8333917b9ceb', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d26e10f-4316-4e2e-9660-651dca78eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d26e10f-4316-4e2e-9660-651dca78eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235dfdba-6c25-4b4c-afa0-c624e9559610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:19 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Volume 677152f7-4873-43a6-a78d-8333917b9ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677152f7-4873-43a6-a78d-8333917b9ceb', 'volume_size': 1}
Jul 07 22:41:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-5c2230e3-9c70-482b-9559-f25f5346c6d8 req-fb5bd9c3-5077-486a-9c5a-4b4ffff06c10 tempest-AttachVolumeNegativeTest-1688201570 None] Terminate volume connection completed successfully.
Jul 07 22:41:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-5c2230e3-9c70-482b-9559-f25f5346c6d8 req-fb5bd9c3-5077-486a-9c5a-4b4ffff06c10 tempest-AttachVolumeNegativeTest-1688201570 None] Deleting attachment 7394d035-f01b-4c2c-96c2-b7b1690d1a69. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:41:24 devstack sudo[96265]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1" returned: 0 in 5.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7be1db-1528-422d-8ebe-dffa7566785a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:25 devstack sudo[96281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:25 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:25 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 0.889s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:25 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:41:25 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Converted 1024.00 MB image at 180.83 MB/s
Jul 07 22:41:25 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 is being set with open permissions: ugo+rw
Jul 07 22:41:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:25 devstack sudo[96288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1
Jul 07 22:41:25 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:26 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1" returned: 0 in 0.621s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" released by "_copy_volume_from_snapshot" :: held 9.272s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81-16355f7c-66f2-4299-8e91-1a1395f2b7a1" released by "_create_volume_from_snapshot" :: held 9.317s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.348s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.643s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-984543035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677152f7-4873-43a6-a78d-8333917b9ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea6b4e860d8b4e159141511c8a553c64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:20Z,use_quota=True,user_id='d4d1433ccb1e444e82ca37c5006ab177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Creating volume 677152f7-4873-43a6-a78d-8333917b9ceb {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:26 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:26 devstack sudo[96291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb 1073741824
Jul 07 22:41:26 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:27 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb 1073741824" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca796c-018f-4dbc-ab9c-b3fedd32deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1', 'volume_size': 1, 'snapshot_id': '057ec841-098f-42ae-973c-5281cf5caf81'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf695aa6-d72a-423e-bcd6-f59218efa09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Volume volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 (16355f7c-66f2-4299-8e91-1a1395f2b7a1): created successfully
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf695aa6-d72a-423e-bcd6-f59218efa09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Flow 'volume_create_manager' (f273be38-1e04-4a17-a0d2-ff25651011e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c029332a-043e-4fea-aaf4-2657405053ea tempest-VolumesDeleteCascade-1505101235 None] Created volume successfully.
Jul 07 22:41:27 devstack sudo[96297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb
Jul 07 22:41:27 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (337dec39-edb7-424d-93d1-ccb9da06cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd03cd7-f633-49e4-a966-09f33f84ee6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd03cd7-f633-49e4-a966-09f33f84ee6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664561271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a2d9cd-30b2-4c84-8465-823dd31ffeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:28Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5545ffb7-054a-47d4-aebf-8f5946a19e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5545ffb7-054a-47d4-aebf-8f5946a19e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9309aa4-06ed-4ddb-9362-0283de6bdd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9309aa4-06ed-4ddb-9362-0283de6bdd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a2d9cd-30b2-4c84-8465-823dd31ffeab', 'volume_name': 'volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019f1588-4c7f-4a2a-ad1d-4f7516e3cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019f1588-4c7f-4a2a-ad1d-4f7516e3cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cd4eb5-4571-4a2a-b8c4-5943c582e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Volume f7a2d9cd-30b2-4c84-8465-823dd31ffeab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab', 'volume_size': 1}
Jul 07 22:41:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-4c2f9dde-7b62-4f14-9730-8d5da358fde5-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-4c2f9dde-7b62-4f14-9730-8d5da358fde5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Performing cascade delete. {{(pid=88152) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-057ec841-098f-42ae-973c-5281cf5caf81-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-057ec841-098f-42ae-973c-5281cf5caf81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Deleting offline snapshot 057ec841-098f-42ae-973c-5281cf5caf81 of volume 4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] snapshot_file for this snap is: volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da91f79-f506-42e6-8ac6-795ffd10b78f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:28 devstack sudo[96300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:28 devstack sudo[96300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:28 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb" returned: 0 in 0.897s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-664561271',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a2d9cd-30b2-4c84-8465-823dd31ffeab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1cc2ac1910e41b38a0d78e5931efdb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:28Z,use_quota=True,user_id='12926c38304644d38bc6cd07c1ed9ee0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Creating volume f7a2d9cd-30b2-4c84-8465-823dd31ffeab {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:28 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:28 devstack sudo[96302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab 1073741824
Jul 07 22:41:28 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235dfdba-6c25-4b4c-afa0-c624e9559610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677152f7-4873-43a6-a78d-8333917b9ceb', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe11c605-4abd-408d-af54-0091d212af45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Volume volume-677152f7-4873-43a6-a78d-8333917b9ceb (677152f7-4873-43a6-a78d-8333917b9ceb): created successfully
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe11c605-4abd-408d-af54-0091d212af45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Flow 'volume_create_manager' (ea7a8381-830b-4faf-aab6-c80456c5a8d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f531bcb3-fa64-441f-abb9-2e502265b9da tempest-VolumesMetadataTest-1324500214 None] Created volume successfully.
Jul 07 22:41:29 devstack sudo[96300]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 0.870s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6d8285-3d1b-4e06-ad04-f0ccd873f2f6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:29 devstack sudo[96317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:29 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:29 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab 1073741824" returned: 0 in 1.270s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:29 devstack sudo[96335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab
Jul 07 22:41:29 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Acquiring lock "cinder-677152f7-4873-43a6-a78d-8333917b9ceb-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "cinder-677152f7-4873-43a6-a78d-8333917b9ceb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Acquiring lock "cinder-quobyte-677152f7-4873-43a6-a78d-8333917b9ceb" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "cinder-quobyte-677152f7-4873-43a6-a78d-8333917b9ceb" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5e7a8-f158-4bf9-8729-afd640ca8343]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:30 devstack sudo[96338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb
Jul 07 22:41:30 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:30 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 1.306s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:30 devstack sudo[96344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:30 devstack sudo[96344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:30 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" returned: 0 in 1.025s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.360s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7cd4eb5-4571-4a2a-b8c4-5943c582e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff682a55-b141-49fe-83bd-be842f751eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Volume volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab (f7a2d9cd-30b2-4c84-8465-823dd31ffeab): created successfully
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff682a55-b141-49fe-83bd-be842f751eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Flow 'volume_create_manager' (337dec39-edb7-424d-93d1-ccb9da06cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c2486f35-8c62-4f19-a39b-b5e5e3bcd567 tempest-AttachVolumeTestJSON-727612247 None] Created volume successfully.
Jul 07 22:41:31 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb" returned: 0 in 1.083s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:31 devstack sudo[96351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb
Jul 07 22:41:31 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:31 devstack sudo[96344]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 1.003s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:31 devstack sudo[96357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81
Jul 07 22:41:31 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:32 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-677152f7-4873-43a6-a78d-8333917b9ceb" returned: 0 in 0.796s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "cinder-quobyte-677152f7-4873-43a6-a78d-8333917b9ceb" released by "delete_volume" :: held 1.952s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Created reservations ['8c24cf0a-63ff-42c2-8878-33fc7efc9d54', 'abbc28dd-a805-4c83-900b-c13617495b6e', 'b4b85246-4873-4ae3-988b-4118b962811b', '8470ba1f-7505-4583-acbf-caa6a6ddbd07'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:32 devstack sudo[96365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:32 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:32 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5.057ec841-098f-42ae-973c-5281cf5caf81" returned: 0 in 0.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-057ec841-098f-42ae-973c-5281cf5caf81" released by "_delete_snapshot" :: held 4.035s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" released by "delete_snapshot" :: held 4.067s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['e1933042-f186-4861-b4dc-083f06314d05', '76ef18d6-cd3d-4d9d-9182-fbb9ab861794', 'd6a8798f-47ff-4f0c-bf9a-97b4147e36ad', '9822190f-a4d9-469d-953d-5d9190cab2c8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Delete snapshot completed successfully.
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-057ec841-098f-42ae-973c-5281cf5caf81-delete_snapshot" released by "delete_snapshot" :: held 4.315s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Snapshots deleted, issuing volume delete {{(pid=88152) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[810571e0-e5b5-4d8f-875e-dbe40ef60884]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:32 devstack sudo[96367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:32 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:33 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.781s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:33 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Deleted volume successfully.
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-aa6cc81c-d099-410c-8578-c9ce6a7b604d tempest-VolumesMetadataTest-1324500214 None] Lock "cinder-677152f7-4873-43a6-a78d-8333917b9ceb-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:33 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 0.969s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:33 devstack sudo[96373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5
Jul 07 22:41:33 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:33 devstack sudo[96375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:33 devstack sudo[96375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:34 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4c2f9dde-7b62-4f14-9730-8d5da358fde5" returned: 0 in 0.983s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-4c2f9dde-7b62-4f14-9730-8d5da358fde5" released by "delete_volume" :: held 2.052s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['4b83cb43-a7dc-40e7-8d21-5fe4c74c35df', 'a0fa18a6-0b7a-439c-9ebf-ecda7d8d250f', '6af73adc-cfdc-42f0-9912-e38e951dad8c', '79de51ce-9e0c-4205-9554-c36d9e08cb30'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:34 devstack sudo[96375]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.990s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:34 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:34 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:35 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.745s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Deleted volume successfully.
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5feaef40-33f4-47d4-b33f-dc6270714b16 tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-4c2f9dde-7b62-4f14-9730-8d5da358fde5-delete_volume" released by "delete_volume" :: held 7.514s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2493e096-9568-46a3-8081-e67487424604]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:35 devstack sudo[96392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab
Jul 07 22:41:35 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-16355f7c-66f2-4299-8e91-1a1395f2b7a1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-16355f7c-66f2-4299-8e91-1a1395f2b7a1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa068fb-138d-4bee-8dfa-2f16565f1388]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:36 devstack sudo[96394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1
Jul 07 22:41:36 devstack sudo[96394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:36 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" returned: 0 in 1.081s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.112s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf6d4859-940a-40b7-933f-bdd047048fae', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:41:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-98f13525-f3dc-4895-89c2-2e113fd7c66a req-3a525dff-1696-40ec-bc25-1e7a6b103fb3 tempest-AttachVolumeTestJSON-727612247 None] attachment_update completed successfully.
Jul 07 22:41:37 devstack sudo[96394]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1" returned: 0 in 1.252s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:37 devstack sudo[96408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1
Jul 07 22:41:37 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:38 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-16355f7c-66f2-4299-8e91-1a1395f2b7a1" returned: 0 in 0.829s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-quobyte-16355f7c-66f2-4299-8e91-1a1395f2b7a1" released by "delete_volume" :: held 2.172s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Created reservations ['60f491d3-93a2-4b15-a9c7-da8381485118', '21140d18-4781-4d85-ac04-848219823ef6', '2e495c0d-1c03-439f-aa22-a0e98a61728b', 'a63b9b02-ea7a-41a5-a03a-a00cbeea28aa'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Flow 'volume_create_manager' (6bbaafc7-bb24-4f63-a2d9-3e5394de9d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56a7bfd-1224-4e69-a2ce-024fcd5d8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56a7bfd-1224-4e69-a2ce-024fcd5d8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-536158065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3560530b-5881-428f-a242-31108d2a1efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459bc072cfd141699717234f3304d54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:39Z,use_quota=True,user_id='f28350c2f85649a085d4acc3718f053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc35174-d696-4587-922b-d7e97df0c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adc35174-d696-4587-922b-d7e97df0c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2a2dc-008a-4c61-8ecb-0341b8da999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15d2a2dc-008a-4c61-8ecb-0341b8da999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3560530b-5881-428f-a242-31108d2a1efe', 'volume_name': 'volume-3560530b-5881-428f-a242-31108d2a1efe', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dce91c-aa3a-4edc-b0d0-5e24e76b6675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dce91c-aa3a-4edc-b0d0-5e24e76b6675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d61eed-ccbd-42e0-8b03-84e3ad3eb27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Volume 3560530b-5881-428f-a242-31108d2a1efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3560530b-5881-428f-a242-31108d2a1efe', 'volume_size': 1}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-536158065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3560530b-5881-428f-a242-31108d2a1efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459bc072cfd141699717234f3304d54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:39Z,use_quota=True,user_id='f28350c2f85649a085d4acc3718f053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Creating volume 3560530b-5881-428f-a242-31108d2a1efe {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:38 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:38 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe 1073741824
Jul 07 22:41:38 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:38 devstack sudo[96415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:38 devstack sudo[96415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:39 devstack sudo[96415]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Deleted volume successfully.
Jul 07 22:41:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e288c4d8-fe1b-4380-90c5-c8c081b677fa tempest-VolumesDeleteCascade-1505101235 None] Lock "cinder-16355f7c-66f2-4299-8e91-1a1395f2b7a1-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:39 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe 1073741824" returned: 0 in 0.998s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:39 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe
Jul 07 22:41:39 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:40 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe" returned: 0 in 0.690s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2d61eed-ccbd-42e0-8b03-84e3ad3eb27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3560530b-5881-428f-a242-31108d2a1efe', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b190906e-0473-497f-8d40-29b28a901cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Volume volume-3560530b-5881-428f-a242-31108d2a1efe (3560530b-5881-428f-a242-31108d2a1efe): created successfully
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b190906e-0473-497f-8d40-29b28a901cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Flow 'volume_create_manager' (6bbaafc7-bb24-4f63-a2d9-3e5394de9d08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ee5cc6b-64e1-43ec-ae96-e302c4b4cc29 tempest-VolumesTransfersV357Test-426261666 None] Created volume successfully.
Jul 07 22:41:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-22284f90-f408-4b2c-93fe-459f72ffa51f tempest-VolumesTransfersV357Test-585963343 None] Transfer volume completed successfully.
Jul 07 22:41:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-1ed9952a-94fe-45c9-8deb-2c189b4ed9af req-e1b86f82-9c8e-4cea-93ca-be57a2ace9a4 tempest-AttachVolumeTestJSON-727612247 None] Terminate volume connection completed successfully.
Jul 07 22:41:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-1ed9952a-94fe-45c9-8deb-2c189b4ed9af req-e1b86f82-9c8e-4cea-93ca-be57a2ace9a4 tempest-AttachVolumeTestJSON-727612247 None] Deleting attachment e62239d1-d233-443c-b1cb-596b9a8e5d14. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "cinder-3560530b-5881-428f-a242-31108d2a1efe-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-3560530b-5881-428f-a242-31108d2a1efe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "cinder-quobyte-3560530b-5881-428f-a242-31108d2a1efe" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-quobyte-3560530b-5881-428f-a242-31108d2a1efe" acquired by "delete_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a98927-6d88-425f-bd5d-2580945f2f8a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:43 devstack sudo[96434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe
Jul 07 22:41:43 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:44 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe" returned: 0 in 0.979s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:44 devstack sudo[96440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe
Jul 07 22:41:44 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:44 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3560530b-5881-428f-a242-31108d2a1efe" returned: 0 in 0.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-quobyte-3560530b-5881-428f-a242-31108d2a1efe" released by "delete_volume" :: held 1.745s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:44 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Created reservations ['69671fc1-b7fe-4983-a24f-3c3e8e84e3c3', 'e42646d1-e1de-4d5c-a3d3-beced1500254', '57bb27f1-684e-4ba2-b682-084f2588c74f', '9fc71b0e-73f1-48c6-9277-07ebd715d894'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:45 devstack sudo[96443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:45 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Flow 'volume_create_manager' (0120c8dd-5497-4911-ad3b-ecd99aba4c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87774776-9080-4d22-b106-80e852ffd962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87774776-9080-4d22-b106-80e852ffd962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-833278760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64260dbb-1652-4ea3-b15b-d3a679b72e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a71908590243178b1c6c1efb41ba52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:45Z,use_quota=True,user_id='17282e2ad84f464897e51100d8a46446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4b569-3249-496b-90d1-329afa7f1aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea4b569-3249-496b-90d1-329afa7f1aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273eb50c-750a-490d-a714-819ce0df7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273eb50c-750a-490d-a714-819ce0df7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64260dbb-1652-4ea3-b15b-d3a679b72e42', 'volume_name': 'volume-64260dbb-1652-4ea3-b15b-d3a679b72e42', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236b0277-de41-4ba8-bb1f-b7c02e5286f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236b0277-de41-4ba8-bb1f-b7c02e5286f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12e2a5e-65ee-454d-abcc-aa4054932c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:45 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Volume 64260dbb-1652-4ea3-b15b-d3a679b72e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64260dbb-1652-4ea3-b15b-d3a679b72e42', 'volume_size': 1}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-833278760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64260dbb-1652-4ea3-b15b-d3a679b72e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a71908590243178b1c6c1efb41ba52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:45Z,use_quota=True,user_id='17282e2ad84f464897e51100d8a46446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Creating volume 64260dbb-1652-4ea3-b15b-d3a679b72e42 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:45 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-700d2d92-7dcd-458f-8ac3-ae5612e8b097 req-1ee3f9f3-38ee-4d67-9dac-e74301256383 tempest-AttachVolumeTestJSON-727612247 None] Terminate volume connection completed successfully.
Jul 07 22:41:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-700d2d92-7dcd-458f-8ac3-ae5612e8b097 req-1ee3f9f3-38ee-4d67-9dac-e74301256383 tempest-AttachVolumeTestJSON-727612247 None] Deleting attachment bf6d4859-940a-40b7-933f-bdd047048fae. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:41:45 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 1073741824
Jul 07 22:41:45 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:46 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Deleted volume successfully.
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cb9906e3-fa8c-49ec-9fce-3acc66e15684 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-3560530b-5881-428f-a242-31108d2a1efe-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Flow 'volume_create_manager' (4079530e-8635-46a1-9375-a42a37faf8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cab21c-d715-42d2-b15c-6ef4a0c7bcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07cab21c-d715-42d2-b15c-6ef4a0c7bcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1756595687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a62ca7-2e19-4d5a-8ff8-6405833fa40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459bc072cfd141699717234f3304d54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:46Z,use_quota=True,user_id='f28350c2f85649a085d4acc3718f053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8055005c-ab7f-46be-80c0-8cd44980733a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8055005c-ab7f-46be-80c0-8cd44980733a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8dae6-af8f-4665-85eb-cf4adfb532e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf8dae6-af8f-4665-85eb-cf4adfb532e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a62ca7-2e19-4d5a-8ff8-6405833fa40c', 'volume_name': 'volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d66aac4-6093-4173-8d94-e66ad7c09088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d66aac4-6093-4173-8d94-e66ad7c09088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff1eb14-6fbb-445b-adbf-ec3c667ed79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:46 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Volume 17a62ca7-2e19-4d5a-8ff8-6405833fa40c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c', 'volume_size': 1}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:46 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 1073741824" returned: 0 in 1.216s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:46 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42
Jul 07 22:41:46 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:47 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42" returned: 0 in 0.773s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1756595687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a62ca7-2e19-4d5a-8ff8-6405833fa40c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='459bc072cfd141699717234f3304d54d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:46Z,use_quota=True,user_id='f28350c2f85649a085d4acc3718f053d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Creating volume 17a62ca7-2e19-4d5a-8ff8-6405833fa40c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:47 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e12e2a5e-65ee-454d-abcc-aa4054932c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64260dbb-1652-4ea3-b15b-d3a679b72e42', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:47 devstack sudo[96460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c 1073741824
Jul 07 22:41:47 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b058e5c3-20e4-4914-94be-3c51b03d072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:47 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Volume volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 (64260dbb-1652-4ea3-b15b-d3a679b72e42): created successfully
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b058e5c3-20e4-4914-94be-3c51b03d072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Flow 'volume_create_manager' (0120c8dd-5497-4911-ad3b-ecd99aba4c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-df9d575a-45ae-4a03-ba30-60605334d4e8 tempest-VolumesTransfersV355Test-1334013847 None] Created volume successfully.
Jul 07 22:41:48 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c 1073741824" returned: 0 in 1.155s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:48 devstack sudo[96483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c
Jul 07 22:41:48 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-44d7e4df-9501-48c5-b6d7-4dc044073abd tempest-VolumesTransfersV355Test-1194083445 None] Transfer volume completed successfully.
Jul 07 22:41:49 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" returned: 0 in 0.734s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aff1eb14-6fbb-445b-adbf-ec3c667ed79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e95550f-5bd7-4c0f-8cde-383ca60203f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Volume volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c (17a62ca7-2e19-4d5a-8ff8-6405833fa40c): created successfully
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e95550f-5bd7-4c0f-8cde-383ca60203f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Flow 'volume_create_manager' (4079530e-8635-46a1-9375-a42a37faf8ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-93306df7-05ce-4dad-a764-b3d5f33677b5 tempest-VolumesTransfersV357Test-426261666 None] Created volume successfully.
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "cinder-64260dbb-1652-4ea3-b15b-d3a679b72e42-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-64260dbb-1652-4ea3-b15b-d3a679b72e42-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "cinder-quobyte-64260dbb-1652-4ea3-b15b-d3a679b72e42" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-quobyte-64260dbb-1652-4ea3-b15b-d3a679b72e42" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[146f9e8b-b32e-4034-89c3-7379b4446cfd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:50 devstack sudo[96507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42
Jul 07 22:41:50 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "cinder-17a62ca7-2e19-4d5a-8ff8-6405833fa40c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-17a62ca7-2e19-4d5a-8ff8-6405833fa40c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "cinder-quobyte-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-quobyte-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[348b007d-9a8d-4bca-bb1f-ca716b4a1d9d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:51 devstack sudo[96511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c
Jul 07 22:41:51 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:51 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42" returned: 0 in 1.065s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:51 devstack sudo[96518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42
Jul 07 22:41:51 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:52 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" returned: 0 in 0.955s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:52 devstack sudo[96525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c
Jul 07 22:41:52 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:52 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-64260dbb-1652-4ea3-b15b-d3a679b72e42" returned: 0 in 1.114s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-quobyte-64260dbb-1652-4ea3-b15b-d3a679b72e42" released by "delete_volume" :: held 2.238s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Created reservations ['cd126fc0-84ed-4e4b-96b6-5a698a69e5e5', '9427af55-a3f1-4825-9487-4bed7670c759', 'bcd38743-9b37-4fc7-a58f-1c98fe0f948e', 'ae7fa6f7-0f46-49c5-8302-f9462dca0b6c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:53 devstack sudo[96567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:53 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:53 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" returned: 0 in 1.123s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-quobyte-17a62ca7-2e19-4d5a-8ff8-6405833fa40c" released by "delete_volume" :: held 2.156s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Created reservations ['6a32cda6-b21c-4ce5-922c-bc59413bfd91', '1e36ce2f-d703-4566-9835-397a34d07641', 'dbcb2ceb-032b-423a-81d4-64f38aff97c9', '15397aab-f1c9-4623-aeb1-4773661c6675'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:53 devstack sudo[96575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:41:53 devstack sudo[96575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:53 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.936s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Deleted volume successfully.
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-188b8b31-d560-4930-982a-d1afa56db031 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-64260dbb-1652-4ea3-b15b-d3a679b72e42-delete_volume" released by "delete_volume" :: held 3.526s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:54 devstack sudo[96575]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:41:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Deleted volume successfully.
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9b52359b-ddf2-4fbd-8082-0417c650c060 tempest-VolumesTransfersV357Test-1808144364 None] Lock "cinder-17a62ca7-2e19-4d5a-8ff8-6405833fa40c-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Flow 'volume_create_manager' (348f1ea8-531e-49e1-95a7-ccf3a496b444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b356a7-6d81-4039-84ce-224896f733c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b356a7-6d81-4039-84ce-224896f733c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1341007216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5cce45-ebe6-42ab-a77c-c4994fa5bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a71908590243178b1c6c1efb41ba52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:55Z,use_quota=True,user_id='17282e2ad84f464897e51100d8a46446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa3e141-3f03-4d23-8392-e04ff590401a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faa3e141-3f03-4d23-8392-e04ff590401a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133637b-b249-4400-a61c-161af6f9d946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f133637b-b249-4400-a61c-161af6f9d946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b5cce45-ebe6-42ab-a77c-c4994fa5bc47', 'volume_name': 'volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8df0d9-c86d-4af2-bcdc-8c0b83832361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8df0d9-c86d-4af2-bcdc-8c0b83832361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573ce05d-b565-4898-a78c-340cd9a7cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Volume 3b5cce45-ebe6-42ab-a77c-c4994fa5bc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47', 'volume_size': 1}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:41:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1341007216',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b5cce45-ebe6-42ab-a77c-c4994fa5bc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6a71908590243178b1c6c1efb41ba52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:41:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:41:55Z,use_quota=True,user_id='17282e2ad84f464897e51100d8a46446',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Creating volume 3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:41:54 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:41:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:54 devstack sudo[96599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 1073741824
Jul 07 22:41:54 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:56 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 1073741824" returned: 0 in 1.485s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:56 devstack sudo[96653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47
Jul 07 22:41:56 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:57 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" returned: 0 in 1.286s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] <== create_volume: return (2872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.874s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573ce05d-b565-4898-a78c-340cd9a7cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e932c9c4-7d96-4dde-b150-0c42f8992e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:41:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Volume volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 (3b5cce45-ebe6-42ab-a77c-c4994fa5bc47): created successfully
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e932c9c4-7d96-4dde-b150-0c42f8992e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:41:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Flow 'volume_create_manager' (348f1ea8-531e-49e1-95a7-ccf3a496b444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:41:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-82f9df47-a91c-4279-a61f-44c089da550e tempest-VolumesTransfersV355Test-1334013847 None] Created volume successfully.
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-f7a2d9cd-30b2-4c84-8465-823dd31ffeab-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-f7a2d9cd-30b2-4c84-8465-823dd31ffeab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-quobyte-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "cinder-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[528a4322-4898-442f-ab54-cb54ab6764ef]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "cinder-quobyte-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-quobyte-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" acquired by "delete_volume" :: waited 0.052s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:41:58 devstack sudo[96658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab
Jul 07 22:41:58 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7544641e-de06-4bca-8e7a-cbcde660e280]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:41:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:59 devstack sudo[96660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47
Jul 07 22:41:59 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:41:59 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:41:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" returned: 0 in 1.270s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:41:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:41:59 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab
Jul 07 22:41:59 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:00 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" returned: 0 in 1.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:00 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47
Jul 07 22:42:00 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:00 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" returned: 0 in 1.177s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-f7a2d9cd-30b2-4c84-8465-823dd31ffeab" released by "delete_volume" :: held 2.553s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Created reservations ['84c35586-ed5b-4a6b-ab2c-11232ca6b3b2', 'f664b555-2e17-4f71-a080-f35c4c88447a', 'e22833a6-7231-41b1-b207-6639ac29ef35', 'd5e6f273-edd7-4fd8-ac38-feb0b0b0bd7f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:01 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:01 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:01 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" returned: 0 in 1.008s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-quobyte-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47" released by "delete_volume" :: held 2.827s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Created reservations ['5e60190e-e803-4b88-b519-673914fa6268', '4de6fbb1-3ed4-475b-a4fb-5e416c610463', 'c0fd75a6-033c-4e9e-9b22-04db5b51a627', '2ccd1b47-e3fc-4bd8-9414-6fca6fe88804'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:01 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:01 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-a44e418b-633e-427d-b2f9-e9b7cca0da27-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-a44e418b-633e-427d-b2f9-e9b7cca0da27-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-quobyte-a44e418b-633e-427d-b2f9-e9b7cca0da27" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-a44e418b-633e-427d-b2f9-e9b7cca0da27" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d002117-f4c5-41f3-9fa6-29f75820f754]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:02 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.138s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Deleted volume successfully.
Jul 07 22:42:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4216fdba-b5b2-4e18-a884-dde8236718eb tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-f7a2d9cd-30b2-4c84-8465-823dd31ffeab-delete_volume" released by "delete_volume" :: held 4.076s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:02 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27
Jul 07 22:42:02 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:03 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.213s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:03 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Deleted volume successfully.
Jul 07 22:42:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cc39ace0-e682-4a64-86bb-195c7a136ff2 tempest-VolumesTransfersV355Test-658695892 None] Lock "cinder-3b5cce45-ebe6-42ab-a77c-c4994fa5bc47-delete_volume" released by "delete_volume" :: held 4.588s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:03 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27" returned: 0 in 1.220s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:03 devstack sudo[96687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27
Jul 07 22:42:03 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:04 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a44e418b-633e-427d-b2f9-e9b7cca0da27" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-a44e418b-633e-427d-b2f9-e9b7cca0da27" released by "delete_volume" :: held 2.147s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Created reservations ['c0cc13f0-83ae-4483-8fec-2ce66ed7226d', 'd7708352-3b36-4d44-9a77-6f4a87844db1', 'ad231802-782e-4fe8-b479-868e2612d722', '96b2070e-1717-4205-b3e8-c7c417231ea9'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:04 devstack sudo[96690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:04 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Flow 'volume_create_manager' (b98faf67-df81-4c35-9398-5d69948c9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a120694-946e-460d-907a-8b3ef2a6ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a120694-946e-460d-907a-8b3ef2a6ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-624057822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c966aae9-c4cd-4ab7-9438-94772395217a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c0236c2f4e4e488c6e07a03415d861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:05Z,use_quota=True,user_id='95a025a532804093bdd883ccfda0f726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831aefc7-c2f9-4716-a15f-5fae0cf3c4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (831aefc7-c2f9-4716-a15f-5fae0cf3c4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781949e9-0e71-45e6-b1ec-482501c45083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781949e9-0e71-45e6-b1ec-482501c45083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c966aae9-c4cd-4ab7-9438-94772395217a', 'volume_name': 'volume-c966aae9-c4cd-4ab7-9438-94772395217a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72507d7c-0b52-486b-840e-6dc37a36a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72507d7c-0b52-486b-840e-6dc37a36a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af1cf2a-7d8a-49a3-acd8-500ad23e2339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:05 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Volume c966aae9-c4cd-4ab7-9438-94772395217a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c966aae9-c4cd-4ab7-9438-94772395217a', 'volume_size': 1}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-624057822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c966aae9-c4cd-4ab7-9438-94772395217a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c0236c2f4e4e488c6e07a03415d861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:05Z,use_quota=True,user_id='95a025a532804093bdd883ccfda0f726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Creating volume c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:05 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:05 devstack sudo[96693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a 1073741824
Jul 07 22:42:05 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-e9e6dc9f-ba4b-430c-81c7-112e48923326-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-e9e6dc9f-ba4b-430c-81c7-112e48923326-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:05 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.150s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Deleted volume successfully.
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4dafe1fe-5a11-4ad1-8318-d9b867173786 tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-a44e418b-633e-427d-b2f9-e9b7cca0da27-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "cinder-quobyte-e9e6dc9f-ba4b-430c-81c7-112e48923326" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-e9e6dc9f-ba4b-430c-81c7-112e48923326" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[147b7453-d9b5-4b09-a8d8-15b16e689775]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:06 devstack sudo[96696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326
Jul 07 22:42:06 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:06 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a 1073741824" returned: 0 in 1.399s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:06 devstack sudo[96702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:06 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:07 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326" returned: 0 in 1.181s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:07 devstack sudo[96708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326
Jul 07 22:42:07 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:07 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 0.999s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] <== create_volume: return (2464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.467s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af1cf2a-7d8a-49a3-acd8-500ad23e2339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c966aae9-c4cd-4ab7-9438-94772395217a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130f43b5-2f46-4ca7-8076-03c81560394b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:07 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Volume volume-c966aae9-c4cd-4ab7-9438-94772395217a (c966aae9-c4cd-4ab7-9438-94772395217a): created successfully
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130f43b5-2f46-4ca7-8076-03c81560394b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Flow 'volume_create_manager' (b98faf67-df81-4c35-9398-5d69948c9603) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9641b8d1-f406-4572-8073-8d3381d157c8 tempest-VolumesCloneTest-1611334976 None] Created volume successfully.
Jul 07 22:42:08 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e9e6dc9f-ba4b-430c-81c7-112e48923326" returned: 0 in 0.951s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-quobyte-e9e6dc9f-ba4b-430c-81c7-112e48923326" released by "delete_volume" :: held 2.227s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=101,cinder:UPDATE=114,cinder:DELETE=10,cinder:INSERT=32 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=132,cinder:SELECT=98,cinder:INSERT=25,cinder:DELETE=11 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Created reservations ['90c9d030-5d8f-442c-bb0e-6d1199a29543', 'd2008d6e-dac9-4a0e-adfd-55025c2f117d', '45827145-4455-4d52-aee9-453f4f8255d4', '2e36e7b0-746b-4557-8d4f-23b59a01cd1c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:08 devstack sudo[96751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:08 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Flow 'volume_create_manager' (3ebe4ba2-7118-48ab-9e5f-a2968f91227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53de9488-3fcb-42dc-a86e-791922d793a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53de9488-3fcb-42dc-a86e-791922d793a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1996628817',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=203e5f02-313b-49b3-9e41-d66504c81f18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37c0236c2f4e4e488c6e07a03415d861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=c966aae9-c4cd-4ab7-9438-94772395217a,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:09Z,use_quota=True,user_id='95a025a532804093bdd883ccfda0f726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46af3e27-51f3-4e9a-935e-5772a710eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46af3e27-51f3-4e9a-935e-5772a710eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc65d5f-8998-4299-a3cf-101b43e2061d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:09 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc65d5f-8998-4299-a3cf-101b43e2061d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '203e5f02-313b-49b3-9e41-d66504c81f18', 'volume_name': 'volume-203e5f02-313b-49b3-9e41-d66504c81f18', 'volume_size': 2, 'source_volid': 'c966aae9-c4cd-4ab7-9438-94772395217a', 'source_volstatus': 'available'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19ef87b-33d1-4dee-8acb-3f0bd72983ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d19ef87b-33d1-4dee-8acb-3f0bd72983ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b01b826-e349-4498-902b-208b41f797b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Volume 203e5f02-313b-49b3-9e41-d66504c81f18: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-203e5f02-313b-49b3-9e41-d66504c81f18', 'volume_size': 2, 'source_volid': 'c966aae9-c4cd-4ab7-9438-94772395217a', 'source_volstatus': 'available'}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.923s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Deleted volume successfully.
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:09 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Cloning volume c966aae9-c4cd-4ab7-9438-94772395217a to volume 203e5f02-313b-49b3-9e41-d66504c81f18
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4bcd6dd7-2bc4-408d-a0aa-eb949c1457ed tempest-AttachVolumeTestJSON-727612247 None] Lock "cinder-e9e6dc9f-ba4b-430c-81c7-112e48923326-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Creating offline snapshot d0a90b04-09bd-47db-8d46-f662a3c33f86 of volume c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e27e0-f31a-4bc0-b871-4683490f6e8c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:09 devstack sudo[96754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:09 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:10 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 0.819s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:10 devstack sudo[96759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 1G
Jul 07 22:42:10 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:11 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 1G" returned: 0 in 0.898s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c966aae9-c4cd-4ab7-9438-94772395217a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:11 devstack sudo[96766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c966aae9-c4cd-4ab7-9438-94772395217a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:11 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:11 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c966aae9-c4cd-4ab7-9438-94772395217a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:11 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 is being set with open permissions: ugo+rw
Jul 07 22:42:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:12 devstack sudo[96771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:12 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:12 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.754s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:12 devstack sudo[96774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info
Jul 07 22:42:12 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:13 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info" returned: 0 in 0.836s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:13 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info is being set with open permissions: ugo+rw
Jul 07 22:42:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:13 devstack sudo[96777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info
Jul 07 22:42:13 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:14 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.info" returned: 0 in 0.904s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] snapshot: d0a90b04-09bd-47db-8d46-f662a3c33f86, volume: 203e5f02-313b-49b3-9e41-d66504c81f18,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bf8537-b4ad-41b4-a40f-867c18d02a4e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:14 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:14 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:15 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c966aae9-c4cd-4ab7-9438-94772395217a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d876088-7e1a-4d38-ae8e-0b13edbfbc73]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:15 devstack sudo[96788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:15 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:16 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 1.055s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:16 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:42:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:16 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18
Jul 07 22:42:16 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Flow 'volume_create_manager' (de28277b-8b99-40f1-aa10-0fec674a657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a346be17-a3fe-40ff-a5f8-3d1cf789f099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a346be17-a3fe-40ff-a5f8-3d1cf789f099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-127945244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd9457-1920-4953-89ff-16cc55a97cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a221a48c9b46fcbe0a8e4c4df4ee0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:19Z,use_quota=True,user_id='efb3ae93e8ac47178e31976e50278acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff04046-e511-43a1-9746-66d653ef78cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff04046-e511-43a1-9746-66d653ef78cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f139e44-ea65-4b09-b97d-924633df6a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f139e44-ea65-4b09-b97d-924633df6a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21dd9457-1920-4953-89ff-16cc55a97cb5', 'volume_name': 'volume-21dd9457-1920-4953-89ff-16cc55a97cb5', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70612cfc-7364-4ed9-9a33-bacabfdd3aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70612cfc-7364-4ed9-9a33-bacabfdd3aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052e225-a3e5-4aaf-ba46-96d9fb8f6868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:19 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Volume 21dd9457-1920-4953-89ff-16cc55a97cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21dd9457-1920-4953-89ff-16cc55a97cb5', 'volume_size': 1}
Jul 07 22:42:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (6ffaf572-bf8c-4e4f-9d22-ba928630d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4500d6-88c8-4976-aead-24650ddfb201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4500d6-88c8-4976-aead-24650ddfb201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-915541772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24814fd6-68cb-4ffe-967b-acee26d1929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:21Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ec1cfe-e6fa-41cc-851e-5db32c52e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ec1cfe-e6fa-41cc-851e-5db32c52e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcec66c-c4c1-4a03-abfa-9cbf9c8d14e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcec66c-c4c1-4a03-abfa-9cbf9c8d14e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24814fd6-68cb-4ffe-967b-acee26d1929a', 'volume_name': 'volume-24814fd6-68cb-4ffe-967b-acee26d1929a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f206d630-901b-4f67-ab99-1f475c60bce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f206d630-901b-4f67-ab99-1f475c60bce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142c4e8c-d508-4bed-b954-62dc60f1edcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:21 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Volume 24814fd6-68cb-4ffe-967b-acee26d1929a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24814fd6-68cb-4ffe-967b-acee26d1929a', 'volume_size': 1}
Jul 07 22:42:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:22 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18" returned: 0 in 6.171s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[78421184-1a32-4141-b77c-72caebbf8d3c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:23 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:23 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:23 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 1.014s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:23 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:42:23 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Converted 1024.00 MB image at 165.92 MB/s
Jul 07 22:42:23 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 is being set with open permissions: ugo+rw
Jul 07 22:42:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:24 devstack sudo[96815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18
Jul 07 22:42:24 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:24 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18" returned: 0 in 0.711s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" released by "_copy_volume_from_snapshot" :: held 10.128s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-quobyte-d0a90b04-09bd-47db-8d46-f662a3c33f86" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-d0a90b04-09bd-47db-8d46-f662a3c33f86" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Deleting offline snapshot d0a90b04-09bd-47db-8d46-f662a3c33f86 of volume c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] snapshot_file for this snap is: volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b43816-af16-4770-8985-40f33fb36b1c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:24 devstack sudo[96818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:24 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:25 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.838s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c966aae9-c4cd-4ab7-9438-94772395217a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:42:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead71921-ba1b-4d45-a306-37747931780d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:25 devstack sudo[96824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:25 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:26 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 0.795s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:26 devstack sudo[96829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:26 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:27 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:27 devstack sudo[96835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86
Jul 07 22:42:27 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:27 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a.d0a90b04-09bd-47db-8d46-f662a3c33f86" returned: 0 in 0.715s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-d0a90b04-09bd-47db-8d46-f662a3c33f86" released by "_delete_snapshot" :: held 3.237s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.705s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.179s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-127945244',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd9457-1920-4953-89ff-16cc55a97cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a221a48c9b46fcbe0a8e4c4df4ee0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:19Z,use_quota=True,user_id='efb3ae93e8ac47178e31976e50278acf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Creating volume 21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:28 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:28 devstack sudo[96838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 1073741824
Jul 07 22:42:28 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b01b826-e349-4498-902b-208b41f797b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-203e5f02-313b-49b3-9e41-d66504c81f18', 'volume_size': 2, 'source_volid': 'c966aae9-c4cd-4ab7-9438-94772395217a', 'source_volstatus': 'available'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3dab8a-d3e4-4ba4-b82d-5c53a3937024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Volume volume-203e5f02-313b-49b3-9e41-d66504c81f18 (203e5f02-313b-49b3-9e41-d66504c81f18): created successfully
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3dab8a-d3e4-4ba4-b82d-5c53a3937024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Flow 'volume_create_manager' (3ebe4ba2-7118-48ab-9e5f-a2968f91227d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bdc56f29-7ee1-4763-8597-e991e3616421 tempest-VolumesCloneTest-1611334976 None] Created volume successfully.
Jul 07 22:42:29 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 1073741824" returned: 0 in 0.958s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:29 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5
Jul 07 22:42:29 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-203e5f02-313b-49b3-9e41-d66504c81f18-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-203e5f02-313b-49b3-9e41-d66504c81f18-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf47bb-5658-4a9f-8a1c-c38984e625bc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:29 devstack sudo[96846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18
Jul 07 22:42:29 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:29 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5" returned: 0 in 0.768s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.079s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-915541772',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24814fd6-68cb-4ffe-967b-acee26d1929a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:21Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Creating volume 24814fd6-68cb-4ffe-967b-acee26d1929a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:29 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:29 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a 1073741824
Jul 07 22:42:29 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4052e225-a3e5-4aaf-ba46-96d9fb8f6868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dd9457-1920-4953-89ff-16cc55a97cb5', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9b4991-0a29-4d80-b660-7ac54ae39a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Volume volume-21dd9457-1920-4953-89ff-16cc55a97cb5 (21dd9457-1920-4953-89ff-16cc55a97cb5): created successfully
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9b4991-0a29-4d80-b660-7ac54ae39a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Flow 'volume_create_manager' (de28277b-8b99-40f1-aa10-0fec674a657c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-80aa5b64-4f17-4efa-8a4d-d34763ca93f0 req-bb45b429-56e9-42a8-a2c3-7ddc3ea4095e tempest-VolumesSnapshotsTestJSON-629551794 None] Created volume successfully.
Jul 07 22:42:30 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18" returned: 0 in 1.116s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:30 devstack sudo[96855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18
Jul 07 22:42:30 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:31 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a 1073741824" returned: 0 in 1.186s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:31 devstack sudo[96861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a
Jul 07 22:42:31 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:31 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-203e5f02-313b-49b3-9e41-d66504c81f18" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-203e5f02-313b-49b3-9e41-d66504c81f18" released by "delete_volume" :: held 2.002s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Created reservations ['81806b24-ac15-4312-930f-217afc1aea6f', '23509046-3e8f-418e-a003-ed7770d6768d', 'e107d847-e400-452c-81a5-d8d4713b0b21', '01cfeb46-0832-4c86-8448-ec10d393b608'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:31 devstack sudo[96864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:31 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-c966aae9-c4cd-4ab7-9438-94772395217a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-c966aae9-c4cd-4ab7-9438-94772395217a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "cinder-quobyte-c966aae9-c4cd-4ab7-9438-94772395217a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-c966aae9-c4cd-4ab7-9438-94772395217a" acquired by "delete_volume" :: waited 0.031s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1abd1ed-a149-4e59-b1ae-76c9d0e87dca]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:32 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a" returned: 0 in 1.060s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:32 devstack sudo[96867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:32 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.305s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Creating offline snapshot 4d2d2ded-f39b-4310-9df9-cf72f207f6b4 of volume 21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142c4e8c-d508-4bed-b954-62dc60f1edcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24814fd6-68cb-4ffe-967b-acee26d1929a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358d3e66-90bf-4302-bcd7-6892d76fb75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a243f-4c57-4dc2-87de-1a5202f6e201]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Volume volume-24814fd6-68cb-4ffe-967b-acee26d1929a (24814fd6-68cb-4ffe-967b-acee26d1929a): created successfully
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358d3e66-90bf-4302-bcd7-6892d76fb75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (6ffaf572-bf8c-4e4f-9d22-ba928630d24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8e32ce65-bf87-45f0-920e-f4dcc5e1974f tempest-AttachVolumeNegativeTest-1688201570 None] Created volume successfully.
Jul 07 22:42:32 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5
Jul 07 22:42:32 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:32 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.046s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Deleted volume successfully.
Jul 07 22:42:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f449401-31ea-4b4e-bd16-3b72fc436306 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-203e5f02-313b-49b3-9e41-d66504c81f18-delete_volume" released by "delete_volume" :: held 3.381s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:33 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 1.042s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:33 devstack sudo[96875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a
Jul 07 22:42:33 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:33 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5" returned: 0 in 1.128s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:33 devstack sudo[96884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 1G
Jul 07 22:42:33 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:33 devstack sudo[96887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:33 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:33 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c966aae9-c4cd-4ab7-9438-94772395217a" returned: 0 in 0.922s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-quobyte-c966aae9-c4cd-4ab7-9438-94772395217a" released by "delete_volume" :: held 2.086s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Created reservations ['5747f597-628b-43e3-8d4d-325269f4479b', '0ffe7ddc-b8c2-45c0-b16b-a6c26d94007c', '74c4cd06-f139-47b1-8bff-c618d8486e0d', 'ef59888d-3bed-4ab7-afdb-a04d2b4bb38a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:34 devstack sudo[96892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:34 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:34 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 1G" returned: 0 in 1.155s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd9457-1920-4953-89ff-16cc55a97cb5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:34 devstack sudo[96894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd9457-1920-4953-89ff-16cc55a97cb5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4
Jul 07 22:42:34 devstack sudo[96894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:34 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:42:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:42:34 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.820s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Deleted volume successfully.
Jul 07 22:42:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8bfe49aa-c994-4b5c-a657-2164e9906b33 tempest-VolumesCloneTest-1611334976 None] Lock "cinder-c966aae9-c4cd-4ab7-9438-94772395217a-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:35 devstack sudo[96894]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd9457-1920-4953-89ff-16cc55a97cb5 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:35 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 is being set with open permissions: ugo+rw
Jul 07 22:42:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:35 devstack sudo[96902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4
Jul 07 22:42:35 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:36 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4" returned: 0 in 0.877s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:36 devstack sudo[96914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info
Jul 07 22:42:36 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:37 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info" returned: 0 in 0.892s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:37 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info is being set with open permissions: ugo+rw
Jul 07 22:42:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:37 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info
Jul 07 22:42:37 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:38 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.info" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.894s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.589s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1a65bd-796f-4707-8199-679f934231ff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-7321707d-f3c1-4110-9860-9fad0a29ecfe req-9497c46c-2288-43eb-bead-697f4ee14302 tempest-VolumesSnapshotsTestJSON-629551794 None] Create snapshot completed successfully
Jul 07 22:42:38 devstack sudo[96926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a
Jul 07 22:42:38 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:38 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-24814fd6-68cb-4ffe-967b-acee26d1929a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4d9cd00-52c7-4495-97f9-cfe6e29f810c', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:42:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-68588a91-8acb-474d-89db-ca7a9fe5bfde req-8977b8f8-e1da-45db-af4b-32993d271246 tempest-AttachVolumeNegativeTest-1688201570 None] attachment_update completed successfully.
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "cinder-4d2d2ded-f39b-4310-9df9-cf72f207f6b4-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-4d2d2ded-f39b-4310-9df9-cf72f207f6b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "cinder-quobyte-4d2d2ded-f39b-4310-9df9-cf72f207f6b4" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-4d2d2ded-f39b-4310-9df9-cf72f207f6b4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Deleting offline snapshot 4d2d2ded-f39b-4310-9df9-cf72f207f6b4 of volume 21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] snapshot_file for this snap is: volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99ba59b-2780-4316-93f8-2f4d685faf77]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:39 devstack sudo[96931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4
Jul 07 22:42:39 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:40 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4" returned: 0 in 0.987s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21dd9457-1920-4953-89ff-16cc55a97cb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:42:40 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc6b2f2-3a5a-4f37-9d2b-0621f92aa84b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:40 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5
Jul 07 22:42:40 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:41 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5" returned: 0 in 0.886s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:41 devstack sudo[97324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4
Jul 07 22:42:41 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:42 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4" returned: 0 in 0.896s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:42 devstack sudo[97332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4
Jul 07 22:42:42 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:42 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5.4d2d2ded-f39b-4310-9df9-cf72f207f6b4" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-4d2d2ded-f39b-4310-9df9-cf72f207f6b4" released by "_delete_snapshot" :: held 3.778s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" released by "delete_snapshot" :: held 3.812s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.quota [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Created reservations ['0007400b-e3cf-48d0-8df3-e03f5f5ff40c', '77c72194-357d-4f2a-99d8-b4632d5b3f8e', 'be7e0eff-32be-4c25-a7b0-530780c68bf8', '19c836ff-b29f-4966-97ab-a4deef9bd205'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Delete snapshot completed successfully.
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-20c1fe3f-3168-417d-858d-1d149f3758ca req-9f3c7ef7-779d-47de-b384-2a9cd0479f52 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-4d2d2ded-f39b-4310-9df9-cf72f207f6b4-delete_snapshot" released by "delete_snapshot" :: held 4.001s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "cinder-21dd9457-1920-4953-89ff-16cc55a97cb5-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-21dd9457-1920-4953-89ff-16cc55a97cb5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9e69cd-a803-460c-a8d2-281fd0649a84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:44 devstack sudo[97336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5
Jul 07 22:42:44 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:44 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5" returned: 0 in 0.957s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:44 devstack sudo[97341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5
Jul 07 22:42:44 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:45 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-21dd9457-1920-4953-89ff-16cc55a97cb5" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-quobyte-21dd9457-1920-4953-89ff-16cc55a97cb5" released by "delete_volume" :: held 1.789s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-3e9deb59-a40d-4543-bec6-7079ed008adc req-74005b65-4154-4790-b445-3e20b057bd9e tempest-AttachVolumeNegativeTest-1688201570 None] Terminate volume connection completed successfully.
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-3e9deb59-a40d-4543-bec6-7079ed008adc req-74005b65-4154-4790-b445-3e20b057bd9e tempest-AttachVolumeNegativeTest-1688201570 None] Deleting attachment f4d9cd00-52c7-4495-97f9-cfe6e29f810c. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG cinder.quota [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Created reservations ['ce88d192-c876-4c8d-a037-ac004cbd58b5', 'd1038827-aa93-4367-bb57-f065f49ae984', '1bbc4803-8a3f-46c9-9b15-d81f0789c4c9', 'eedcc11a-3f17-435e-8ce7-f665b50509c6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:45 devstack sudo[97372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:42:45 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:46 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.040s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:46 devstack cinder-volume[88152]: DEBUG cinder.manager [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:42:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Deleted volume successfully.
Jul 07 22:42:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-c58e778d-dec9-49f3-9681-046847b7f1b7 req-56fd8762-e564-4cf5-8942-0b64a4e2b8a7 tempest-VolumesSnapshotsTestJSON-629551794 None] Lock "cinder-21dd9457-1920-4953-89ff-16cc55a97cb5-delete_volume" released by "delete_volume" :: held 3.163s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (2f8b5aec-7bac-4b03-8ba8-26fd15e10af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c371ac-93c2-45a1-bce1-f51042899729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c371ac-93c2-45a1-bce1-f51042899729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604664071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f11a31c-af4f-4340-a7ed-c18d3af9e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:52Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abcff7-f275-40b7-bb84-f3203ae137c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4abcff7-f275-40b7-bb84-f3203ae137c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd286a9f-7ab0-4bd1-aa5d-26b1dfecac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd286a9f-7ab0-4bd1-aa5d-26b1dfecac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f11a31c-af4f-4340-a7ed-c18d3af9e610', 'volume_name': 'volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224208a-00bb-4b32-86ad-a25266648bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1224208a-00bb-4b32-86ad-a25266648bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8adaac3-1938-4016-9282-94f8d1e0f3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume 5f11a31c-af4f-4340-a7ed-c18d3af9e610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610', 'volume_size': 1}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1604664071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f11a31c-af4f-4340-a7ed-c18d3af9e610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:42:52Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Creating volume 5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:42:52 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:42:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:52 devstack sudo[97424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 1073741824
Jul 07 22:42:52 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:53 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 1073741824" returned: 0 in 1.053s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:53 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610
Jul 07 22:42:53 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:54 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610" returned: 0 in 1.361s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] <== create_volume: return (2465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:42:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:42:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8adaac3-1938-4016-9282-94f8d1e0f3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c6b25b-61bf-4c45-9e97-da49f9a4ed3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:42:55 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 (5f11a31c-af4f-4340-a7ed-c18d3af9e610): created successfully
Jul 07 22:42:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c6b25b-61bf-4c45-9e97-da49f9a4ed3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:42:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (2f8b5aec-7bac-4b03-8ba8-26fd15e10af7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:42:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cbb69449-2d76-4a2d-ace0-9481039a68f7 tempest-VolumesSnapshotTestJSON-1737740172 None] Created volume successfully.
Jul 07 22:42:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:42:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:42:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Creating offline snapshot 7fff5608-7ae1-4ea3-bd6b-7072db2e0bab of volume 5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:42:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bead892-b18a-4bd3-9e8c-e425aab2916c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:42:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:56 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610
Jul 07 22:42:56 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:57 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610" returned: 0 in 1.165s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:57 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab 1G
Jul 07 22:42:57 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:58 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab 1G" returned: 0 in 1.022s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:58 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab
Jul 07 22:42:58 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:42:59 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Jul 07 22:42:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:42:59 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab is being set with open permissions: ugo+rw
Jul 07 22:42:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:42:59 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab
Jul 07 22:42:59 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:00 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" returned: 0 in 1.151s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:00 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info
Jul 07 22:43:00 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3672de6c-de40-4e96-a208-84ffd7475bba tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1418764723: creating
Jul 07 22:43:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3672de6c-de40-4e96-a208-84ffd7475bba tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1418764723: created successfully
Jul 07 22:43:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3672de6c-de40-4e96-a208-84ffd7475bba tempest-GroupSnapshotsTest-523578347 None] Create group completed successfully.
Jul 07 22:43:01 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info" returned: 0 in 1.019s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:01 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info is being set with open permissions: ugo+rw
Jul 07 22:43:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:01 devstack sudo[97574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info
Jul 07 22:43:01 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:02 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.info" returned: 0 in 1.011s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.391s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f975b9e5-a07c-4992-a5b6-fa2e03d1ce81 tempest-VolumesSnapshotTestJSON-1737740172 None] Create snapshot completed successfully
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (0994266c-2fa7-4ea5-8509-561f4ac113a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ebbca-cbb6-4f84-89e9-ff5c44173e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ebbca-cbb6-4f84-89e9-ff5c44173e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578544003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70432f39-dd8f-4d33-a9c5-255ed26b7665,host='devstack@QuobyteHD#QuobyteHD',id=890cf96f-9ebf-42c5-a7c4-efeb18b3b50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:03Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46d0971-8965-46fa-a789-f09e62db9823),volume_type_id=b46d0971-8965-46fa-a789-f09e62db9823)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70474cb6-3bdf-40f3-9a28-9c865a623bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70474cb6-3bdf-40f3-9a28-9c865a623bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6d9da0-1c07-49c0-8779-33d04b8fe4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6d9da0-1c07-49c0-8779-33d04b8fe4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '890cf96f-9ebf-42c5-a7c4-efeb18b3b50a', 'volume_name': 'volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69b948f-0e50-4f85-a8c4-4ef419969a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69b948f-0e50-4f85-a8c4-4ef419969a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188c5206-4a46-4c2a-b87f-5d39bd274c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Volume 890cf96f-9ebf-42c5-a7c4-efeb18b3b50a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a', 'volume_size': 1}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=70432f39-dd8f-4d33-a9c5-255ed26b7665,created_at=2026-07-07T20:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-578544003',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=70432f39-dd8f-4d33-a9c5-255ed26b7665,host='devstack@QuobyteHD#QuobyteHD',id=890cf96f-9ebf-42c5-a7c4-efeb18b3b50a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:03Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b46d0971-8965-46fa-a789-f09e62db9823),volume_type_id=b46d0971-8965-46fa-a789-f09e62db9823)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Creating volume 890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:03 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:03 devstack sudo[97579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a 1073741824
Jul 07 22:43:03 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Flow 'volume_create_manager' (3b5856f3-24a6-4059-b259-891a38991e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a016a8fe-29bd-47b8-9294-36cd0dfa267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a016a8fe-29bd-47b8-9294-36cd0dfa267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1745124975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a617f8-a761-4c18-9fd1-3072d81f4ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e4e8596a72449eb03191548a51cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:03Z,use_quota=True,user_id='e4d26bb91a4f4145aa3581d45b5fefe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841087b0-442f-40dd-a294-7ede9118984a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841087b0-442f-40dd-a294-7ede9118984a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c498869-1151-4f3e-b358-9f7c24e29818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c498869-1151-4f3e-b358-9f7c24e29818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a617f8-a761-4c18-9fd1-3072d81f4ee1', 'volume_name': 'volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821cd49-543a-4301-b615-b71044c99b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5821cd49-543a-4301-b615-b71044c99b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf29f01-f0d3-40fc-ae8c-5e5ceaa942a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Volume d2a617f8-a761-4c18-9fd1-3072d81f4ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1', 'volume_size': 1}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleting offline snapshot 7fff5608-7ae1-4ea3-bd6b-7072db2e0bab of volume 5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] snapshot_file for this snap is: volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80ea537-6430-4212-a8de-cd363c632b8e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:04 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab
Jul 07 22:43:04 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:04 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a 1073741824" returned: 0 in 1.166s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:04 devstack sudo[97590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:04 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:04 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" returned: 0 in 1.012s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e52a14-bbc2-4962-a470-54475e13412c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:05 devstack sudo[97595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610
Jul 07 22:43:05 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:05 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 1.076s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.142s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1745124975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a617f8-a761-4c18-9fd1-3072d81f4ee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3e4e8596a72449eb03191548a51cd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:03Z,use_quota=True,user_id='e4d26bb91a4f4145aa3581d45b5fefe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Creating volume d2a617f8-a761-4c18-9fd1-3072d81f4ee1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:05 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188c5206-4a46-4c2a-b87f-5d39bd274c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8b402-e7e5-41f7-a1a2-8395c5f04264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:06 devstack sudo[97601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 1073741824
Jul 07 22:43:06 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:06 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Volume volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a (890cf96f-9ebf-42c5-a7c4-efeb18b3b50a): created successfully
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8b402-e7e5-41f7-a1a2-8395c5f04264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (0994266c-2fa7-4ea5-8509-561f4ac113a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6bcbfa95-11de-437d-a47d-d00dbc82741c tempest-GroupSnapshotsTest-523578347 None] Created volume successfully.
Jul 07 22:43:06 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610" returned: 0 in 1.210s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:06 devstack sudo[97604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab
Jul 07 22:43:06 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:07 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 1073741824" returned: 0 in 1.100s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:07 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" returned: 0 in 0.882s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:07 devstack sudo[97614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab
Jul 07 22:43:07 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:07 devstack sudo[97616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1
Jul 07 22:43:07 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] GroupSnapshot 86402ba2-7acf-49e5-83e1-98751595dad0: creating.
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Group snapshot 86402ba2-7acf-49e5-83e1-98751595dad0: creating. {{(pid=88152) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:43:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:08 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610.7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" returned: 0 in 0.977s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:08 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" returned: 0 in 0.970s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.164s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab" released by "_delete_snapshot" :: held 4.258s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" released by "delete_snapshot" :: held 4.291s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Creating offline snapshot ba116e71-4d49-448b-b5b8-90bd8e5437f4 of volume 890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf29f01-f0d3-40fc-ae8c-5e5ceaa942a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618734c6-09f6-4963-9015-f9f9a5cd0396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c8247a-70b4-4b16-8c1f-7ed2f871eddc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=56,cinder:INSERT=15,cinder:UPDATE=68,cinder:DELETE=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Volume volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 (d2a617f8-a761-4c18-9fd1-3072d81f4ee1): created successfully
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618734c6-09f6-4963-9015-f9f9a5cd0396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Flow 'volume_create_manager' (3b5856f3-24a6-4059-b259-891a38991e18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=57,cinder:SELECT=71,cinder:INSERT=15,cinder:DELETE=6 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c8d592af-d610-4052-9226-57d4090dde3d tempest-TestMinimumBasicScenario-602261050 None] Created volume successfully.
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['2600166d-cd7a-439d-833f-222110634864', 'a853a224-81f8-4724-b582-7f64e67beba0', '23701118-f9e0-431e-8342-79e268765466', '8e4f1371-88fb-462e-acaa-a6a65a9b4a6a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:08 devstack sudo[97621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:08 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Delete snapshot completed successfully.
Jul 07 22:43:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b33c4834-4164-4a8e-916b-2eab60b14457 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-7fff5608-7ae1-4ea3-bd6b-7072db2e0bab-delete_snapshot" released by "delete_snapshot" :: held 4.720s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:09 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 1.048s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:09 devstack sudo[97629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 1G
Jul 07 22:43:09 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (40e8ec1b-59fb-4b90-a221-a05e3f6da200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eddc0c9-2770-408b-843e-e4f66de48269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eddc0c9-2770-408b-843e-e4f66de48269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121720346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0520803-064a-45e6-a9ed-8866c2be0a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:10Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5bec00-80a1-4e9b-9006-c47f3428334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5bec00-80a1-4e9b-9006-c47f3428334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7259fe6-a951-4f19-92b6-684146b8c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7259fe6-a951-4f19-92b6-684146b8c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0520803-064a-45e6-a9ed-8866c2be0a62', 'volume_name': 'volume-f0520803-064a-45e6-a9ed-8866c2be0a62', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea4e83e-3fba-491f-8cf0-d737e2e4d09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea4e83e-3fba-491f-8cf0-d737e2e4d09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c2d77c-c4fc-4c34-9af9-d731d15925b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume f0520803-064a-45e6-a9ed-8866c2be0a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0520803-064a-45e6-a9ed-8866c2be0a62', 'volume_size': 1}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:10 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 1G" returned: 0 in 1.024s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:10 devstack sudo[97635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:10 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:11 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 0.815s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:11 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:43:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:11 devstack sudo[97641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:11 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:12 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 1.314s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:12 devstack sudo[97670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info
Jul 07 22:43:12 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:13 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info" returned: 0 in 0.828s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:13 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:43:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:13 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info
Jul 07 22:43:13 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:14 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.info" returned: 0 in 0.839s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.082s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.112s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121720346',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0520803-064a-45e6-a9ed-8866c2be0a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:10Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Creating volume f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:14 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:14 devstack sudo[97692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 1073741824
Jul 07 22:43:14 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-be064f3d-392a-4643-a8bc-ee44b041611f tempest-GroupSnapshotsTest-523578347 None] group_snapshot 86402ba2-7acf-49e5-83e1-98751595dad0: created successfully
Jul 07 22:43:15 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 1073741824" returned: 0 in 0.914s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:15 devstack sudo[97698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:15 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:15 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.734s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.291s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c2d77c-c4fc-4c34-9af9-d731d15925b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0520803-064a-45e6-a9ed-8866c2be0a62', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d490c4fc-089c-4961-ae79-227aa5527428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb89a66-35dc-47e4-a324-f10dcb3a173d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume volume-f0520803-064a-45e6-a9ed-8866c2be0a62 (f0520803-064a-45e6-a9ed-8866c2be0a62): created successfully
Jul 07 22:43:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d490c4fc-089c-4961-ae79-227aa5527428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (40e8ec1b-59fb-4b90-a221-a05e3f6da200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ac86f21d-c5d7-4638-8399-4e53ada25616 tempest-VolumesSnapshotTestJSON-1737740172 None] Created volume successfully.
Jul 07 22:43:16 devstack sudo[97702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1
Jul 07 22:43:16 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:17 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" returned: 0 in 1.067s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.102s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.493s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Creating volume 81704f67-f4c0-4eeb-8eea-6a5e11eaab4f from snapshot ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] snapshot: ba116e71-4d49-448b-b5b8-90bd8e5437f4, volume: 81704f67-f4c0-4eeb-8eea-6a5e11eaab4f,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5602e331-d33f-49f1-b564-96172bd2baae', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[147df54b-3ab8-4f6f-9da4-33106feb96e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:17 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:17 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c11f3716-8756-4b18-9a48-c729bace4e0b req-4c3f9902-ab82-4ba2-873e-aea072136b09 tempest-TestMinimumBasicScenario-602261050 None] attachment_update completed successfully.
Jul 07 22:43:18 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 1.370s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc4e1fe-3f54-4fad-ab98-6904261d9a69]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:18 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:18 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:19 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 1.038s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:19 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:43:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:19 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f
Jul 07 22:43:19 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:27 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=20,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:27 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=19,cinder:INSERT=4,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:43:28 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" returned: 0 in 9.192s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f55424-67bd-4c2c-ab46-26c032e3d599]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:29 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:29 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:30 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 1.181s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a, size 1024.00 MB, duration 9.20 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:43:30 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Converted 1024.00 MB image at 111.35 MB/s
Jul 07 22:43:30 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:30 devstack sudo[98197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f
Jul 07 22:43:30 devstack sudo[98197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:30 devstack sudo[98197]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" returned: 0 in 0.846s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" released by "_copy_volume_from_snapshot" :: held 13.841s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" released by "_create_volume_from_snapshot" :: held 13.898s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.932s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.553s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Creating offline snapshot 797325f9-a9ab-419a-8dd9-f2fd652c9481 of volume f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[089dff2c-dcab-4397-bbf3-373a71d6ac1d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9fc21615-4f25-41c9-b30e-8cf6b50dac8f tempest-GroupSnapshotsTest-523578347 None] Create group from source-snapshot-86402ba2-7acf-49e5-83e1-98751595dad0 completed successfully.
Jul 07 22:43:31 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:31 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b5fe4-5613-4bb8-b0b7-4c5fad6e38ad]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:32 devstack sudo[98204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f
Jul 07 22:43:32 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:32 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 1.566s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:32 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 1G
Jul 07 22:43:32 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" returned: 0 in 1.193s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:33 devstack sudo[98251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f
Jul 07 22:43:33 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 1G" returned: 0 in 1.036s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0520803-064a-45e6-a9ed-8866c2be0a62 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:33 devstack sudo[98257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0520803-064a-45e6-a9ed-8866c2be0a62 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:33 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:33 devstack sudo[98260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:43:33 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:33 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" returned: 0 in 0.800s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-81704f67-f4c0-4eeb-8eea-6a5e11eaab4f" released by "delete_volume" :: held 2.067s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['379cc33b-e0cb-47bf-b1af-f6f0a06124d0'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:34 devstack cinder-volume[88152]: WARNING cinder.quota [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1416041673 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1416041673, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:43:34 devstack cinder-volume[88152]: WARNING cinder.quota [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1416041673 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1416041673, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['27cfa1b4-df5b-4869-aca7-7b40e4663a05', '8b639fa5-0fe9-4520-ae7d-b271ebcd5f90', '24f2ee13-eed1-417c-9745-7152612ba763', '00e310b4-6095-4385-a8c7-d3d27394aa7a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:34 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:43:34 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:34 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0520803-064a-45e6-a9ed-8866c2be0a62 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 0.943s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:34 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 is being set with open permissions: ugo+rw
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 86402ba2-7acf-49e5-83e1-98751595dad0: deleting
Jul 07 22:43:34 devstack sudo[98267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:34 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 86402ba2-7acf-49e5-83e1-98751595dad0: deleting {{(pid=88152) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Deleting offline snapshot ba116e71-4d49-448b-b5b8-90bd8e5437f4 of volume 890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] snapshot_file for this snap is: volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:43:34 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.961s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[776706e0-55d9-45ca-975e-577407ed833a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:35 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:35 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:35 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.027s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4956d0c3-2847-4113-ad89-c93abdbc1943 tempest-GroupSnapshotsTest-523578347 None] Delete group completed successfully.
Jul 07 22:43:35 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 1.025s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:35 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info
Jul 07 22:43:35 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:35 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 0.981s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e7e395-a39a-4474-a7fa-d3074bfd1e08]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:36 devstack sudo[98283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:36 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:36 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info" returned: 0 in 0.814s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:36 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info is being set with open permissions: ugo+rw
Jul 07 22:43:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:36 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info
Jul 07 22:43:36 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:36 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 0.976s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:36 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:36 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:37 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.info" returned: 0 in 0.811s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.321s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-284ff0da-3a53-4138-ad25-1d8d49dc8f9e tempest-VolumesSnapshotTestJSON-1737740172 None] Create snapshot completed successfully
Jul 07 22:43:37 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 0.855s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:37 devstack sudo[98301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4
Jul 07 22:43:37 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:38 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a.ba116e71-4d49-448b-b5b8-90bd8e5437f4" returned: 0 in 0.734s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-ba116e71-4d49-448b-b5b8-90bd8e5437f4" released by "_delete_snapshot" :: held 3.719s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" released by "delete_snapshot" :: held 3.765s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:38 devstack cinder-volume[88152]: WARNING cinder.quota [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1416041673 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1416041673, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:43:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] Created reservations ['7aa2ec4b-7d6d-49fb-a243-1a9e3c930b37', '14a292bc-2c89-4b38-b9a4-cb0e5b4fa2d6', '5a494099-7850-4f82-aa1c-3d63e5c03006', '29d958be-e525-4d75-a375-e21c5be246e4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0d792b30-3267-4fb7-95fd-dd02c1f5d89b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 86402ba2-7acf-49e5-83e1-98751595dad0: deleted successfully
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (dd2a4bf4-3e1b-40bd-a15c-9bb43b45a6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adef58ca-9b20-4e5f-b2e3-111fb1a7ae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adef58ca-9b20-4e5f-b2e3-111fb1a7ae80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-829168587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fa715a-df7b-4dc1-bcd4-875f0589db77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=797325f9-a9ab-419a-8dd9-f2fd652c9481,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:39Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4a9bf7-2ede-4311-a531-4d81fe261f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4a9bf7-2ede-4311-a531-4d81fe261f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d2a5e1-0b17-47f0-8157-3e711423c62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d2a5e1-0b17-47f0-8157-3e711423c62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2fa715a-df7b-4dc1-bcd4-875f0589db77', 'volume_name': 'volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77', 'volume_size': 2, 'snapshot_id': '797325f9-a9ab-419a-8dd9-f2fd652c9481'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412d4511-24ca-491a-a595-eec15220b405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412d4511-24ca-491a-a595-eec15220b405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a9982a-c93b-43a0-a347-ba4c809a08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Volume f2fa715a-df7b-4dc1-bcd4-875f0589db77: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77', 'volume_size': 2, 'snapshot_id': '797325f9-a9ab-419a-8dd9-f2fd652c9481'}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481-f2fa715a-df7b-4dc1-bcd4-875f0589db77" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481-f2fa715a-df7b-4dc1-bcd4-875f0589db77" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Creating volume f2fa715a-df7b-4dc1-bcd4-875f0589db77 from snapshot 797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] snapshot: 797325f9-a9ab-419a-8dd9-f2fd652c9481, volume: f2fa715a-df7b-4dc1-bcd4-875f0589db77,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baa6056-36d1-4d73-8efd-515e0f2603a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d124858-7070-4ff1-bd91-8ada82df8014]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:39 devstack sudo[98331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:39 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:39 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:39 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:40 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 1.063s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0520803-064a-45e6-a9ed-8866c2be0a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b293a-422d-41d0-a136-5f4e46410e08]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:40 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 0.990s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:40 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a
Jul 07 22:43:40 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:40 devstack sudo[98341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:40 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:41 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" returned: 0 in 0.817s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:41 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.937s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-890cf96f-9ebf-42c5-a7c4-efeb18b3b50a" released by "delete_volume" :: held 1.909s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:41 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77
Jul 07 22:43:41 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['8e197b3d-59f7-454c-a2d1-f31e3828f3b6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:41 devstack cinder-volume[88152]: WARNING cinder.db.api [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1416041673']
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['1b05d3ef-48b0-4ccb-b034-517eef80c43a', 'c2754ac9-dfcb-4aa0-9bd7-339e3e52257b', '3b3c9782-ed58-4f68-889f-4327261eb963', '0f85d567-5fc6-4774-adbd-e44034bbc29c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:41 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:43:41 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:42 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:42 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a4767d80-3f72-4001-8cda-c8dd4f70ab31 tempest-GroupSnapshotsTest-523578347 None] Delete group completed successfully.
Jul 07 22:43:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ee638a6-4a26-4b2b-824a-e8e0b6a99a3d tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1753184988: creating
Jul 07 22:43:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ee638a6-4a26-4b2b-824a-e8e0b6a99a3d tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1753184988: created successfully
Jul 07 22:43:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ee638a6-4a26-4b2b-824a-e8e0b6a99a3d tempest-GroupSnapshotsTest-523578347 None] Create group completed successfully.
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (cd9f5350-abf8-4a51-bb9c-702af806b171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7052c47-a97a-4355-815b-a46f4b8cd7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7052c47-a97a-4355-815b-a46f4b8cd7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1066398118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a07b015-b0b6-4a8c-8767-d07378678ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:44Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88449a32-6128-443b-8e5f-3be28679f763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88449a32-6128-443b-8e5f-3be28679f763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44350ae5-2a0a-41e4-840c-b04c2aa84ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44350ae5-2a0a-41e4-840c-b04c2aa84ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a07b015-b0b6-4a8c-8767-d07378678ce3', 'volume_name': 'volume-6a07b015-b0b6-4a8c-8767-d07378678ce3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2220c-6405-4a9c-9b24-008e7ec5017a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef2220c-6405-4a9c-9b24-008e7ec5017a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afc78be-df50-412b-b512-82427b757a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:44 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Volume 6a07b015-b0b6-4a8c-8767-d07378678ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a07b015-b0b6-4a8c-8767-d07378678ce3', 'volume_size': 1}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:44 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (cc5250f0-47a1-4934-b3ad-46f0ce8c770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d276b3fa-5576-4e29-85f1-ccfe8a125af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d276b3fa-5576-4e29-85f1-ccfe8a125af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412258209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,host='devstack@QuobyteHD#QuobyteHD',id=88edc3a1-3491-407f-bf15-eb1487d4597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:45Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87),volume_type_id=dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add9cc18-581d-4870-b07a-fcc9b7076b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add9cc18-581d-4870-b07a-fcc9b7076b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc87ae-e0d4-487f-88f4-4b37e19edfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdc87ae-e0d4-487f-88f4-4b37e19edfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88edc3a1-3491-407f-bf15-eb1487d4597e', 'volume_name': 'volume-88edc3a1-3491-407f-bf15-eb1487d4597e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d01bb6-8364-4d3e-b022-3279d18506ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d01bb6-8364-4d3e-b022-3279d18506ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd6c7e8-aad5-4b08-aaa9-e10b9651f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:45 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Volume 88edc3a1-3491-407f-bf15-eb1487d4597e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88edc3a1-3491-407f-bf15-eb1487d4597e', 'volume_size': 1}
Jul 07 22:43:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:47 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77" returned: 0 in 6.212s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[250a57b9-97fd-4717-97ef-59360cc28e57]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:47 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:47 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:48 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.964s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:48 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62, size 1024.00 MB, duration 6.21 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:43:48 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Converted 1024.00 MB image at 164.81 MB/s
Jul 07 22:43:48 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 is being set with open permissions: ugo+rw
Jul 07 22:43:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:48 devstack sudo[98404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77
Jul 07 22:43:48 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:49 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77" returned: 0 in 0.705s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" released by "_copy_volume_from_snapshot" :: held 10.010s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481-f2fa715a-df7b-4dc1-bcd4-875f0589db77" released by "_create_volume_from_snapshot" :: held 10.058s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.089s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1066398118',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a07b015-b0b6-4a8c-8767-d07378678ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11c2da35dbeb4287bc3536b2aabbb192',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:44Z,use_quota=True,user_id='e57b8f93738d40359a206c3aa6c18a79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Creating volume 6a07b015-b0b6-4a8c-8767-d07378678ce3 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:49 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:49 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 1073741824
Jul 07 22:43:49 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a9982a-c93b-43a0-a347-ba4c809a08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77', 'volume_size': 2, 'snapshot_id': '797325f9-a9ab-419a-8dd9-f2fd652c9481'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bbb9c7-6aa3-438f-baa4-f62ff77bdd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Volume volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 (f2fa715a-df7b-4dc1-bcd4-875f0589db77): created successfully
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bbb9c7-6aa3-438f-baa4-f62ff77bdd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (dd2a4bf4-3e1b-40bd-a15c-9bb43b45a6a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-02b55e1c-6562-4931-b770-1fa85e14774d tempest-VolumesSnapshotTestJSON-1737740172 None] Created volume successfully.
Jul 07 22:43:50 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 1073741824" returned: 0 in 0.858s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:50 devstack sudo[98414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3
Jul 07 22:43:50 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-f2fa715a-df7b-4dc1-bcd4-875f0589db77-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f2fa715a-df7b-4dc1-bcd4-875f0589db77-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[434f5325-bf56-413c-9a38-bda94e94c080]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:50 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77
Jul 07 22:43:50 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:50 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3" returned: 0 in 0.765s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.820s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,created_at=2026-07-07T20:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1412258209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,host='devstack@QuobyteHD#QuobyteHD',id=88edc3a1-3491-407f-bf15-eb1487d4597e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:45Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87),volume_type_id=dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Creating volume 88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:50 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afc78be-df50-412b-b512-82427b757a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a07b015-b0b6-4a8c-8767-d07378678ce3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:50 devstack sudo[98419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e 1073741824
Jul 07 22:43:50 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b273b54-2a99-4876-8737-287438daf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Volume volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 (6a07b015-b0b6-4a8c-8767-d07378678ce3): created successfully
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b273b54-2a99-4876-8737-287438daf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Flow 'volume_create_manager' (cd9f5350-abf8-4a51-bb9c-702af806b171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ab962a57-dd81-43db-b2af-1a1dc17c401a tempest-AttachVolumeNegativeTest-1688201570 None] Created volume successfully.
Jul 07 22:43:51 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77" returned: 0 in 0.816s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:51 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77
Jul 07 22:43:51 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:51 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e 1073741824" returned: 0 in 0.898s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:51 devstack sudo[98429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e
Jul 07 22:43:51 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:52 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f2fa715a-df7b-4dc1-bcd4-875f0589db77" returned: 0 in 0.863s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f2fa715a-df7b-4dc1-bcd4-875f0589db77" released by "delete_volume" :: held 1.736s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['b46e6aed-ead7-4867-b092-497834528971', '12f566ed-b29a-4956-b2ef-c805c93274ea', '11a3622d-44c8-4e14-8b03-299aa0d2c516', 'ab7ce020-27f9-4efc-a112-0d3b721175e0'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:52 devstack sudo[98435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:43:52 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:52 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e" returned: 0 in 0.756s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddd6c7e8-aad5-4b08-aaa9-e10b9651f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88edc3a1-3491-407f-bf15-eb1487d4597e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f4d212-d758-4e9e-94a3-801bfa4e85e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Volume volume-88edc3a1-3491-407f-bf15-eb1487d4597e (88edc3a1-3491-407f-bf15-eb1487d4597e): created successfully
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f4d212-d758-4e9e-94a3-801bfa4e85e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (cc5250f0-47a1-4934-b3ad-46f0ce8c770a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ea1420da-f3e7-4c5f-a460-b471eeb9398a tempest-GroupSnapshotsTest-523578347 None] Created volume successfully.
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-797325f9-a9ab-419a-8dd9-f2fd652c9481-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-797325f9-a9ab-419a-8dd9-f2fd652c9481-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleting offline snapshot 797325f9-a9ab-419a-8dd9-f2fd652c9481 of volume f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] snapshot_file for this snap is: volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bee52ba-a684-477a-92c1-d02808b6844a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:53 devstack sudo[98438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:53 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:53 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.741s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:43:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleted volume successfully.
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8674b58d-98a8-4cda-b0af-883763a99919 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f2fa715a-df7b-4dc1-bcd4-875f0589db77-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:53 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 0.763s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0520803-064a-45e6-a9ed-8866c2be0a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2da98e4-ec3e-4062-ab80-d25452a220d5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:53 devstack sudo[98444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:53 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:54 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.941s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:54 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:54 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (a1c540b3-12bf-49a4-8118-4630ab32faac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd91a5-a69b-42b0-af30-ff0397da48f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd91a5-a69b-42b0-af30-ff0397da48f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276844084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,host='devstack@QuobyteHD#QuobyteHD',id=709f0d9f-d12c-40bd-b5f9-ec0d5b932767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:55Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87),volume_type_id=dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ede06c-59a1-4c7a-8feb-59845bc4583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ede06c-59a1-4c7a-8feb-59845bc4583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91133d55-9e3b-4b3d-8247-5cb4446f1850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91133d55-9e3b-4b3d-8247-5cb4446f1850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709f0d9f-d12c-40bd-b5f9-ec0d5b932767', 'volume_name': 'volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c55770d-3dc5-46ff-89b7-b2da9f0fd01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c55770d-3dc5-46ff-89b7-b2da9f0fd01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f83b21-7cb6-479f-8f40-ea21136ea854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Volume 709f0d9f-d12c-40bd-b5f9-ec0d5b932767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767', 'volume_size': 1}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,created_at=2026-07-07T20:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276844084',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0dd8eef7-522a-4bab-b6d9-4203e1ca993c,host='devstack@QuobyteHD#QuobyteHD',id=709f0d9f-d12c-40bd-b5f9-ec0d5b932767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:43:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:43:55Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87),volume_type_id=dd8ca6e2-a4f8-4fbf-b8ab-8ce97cb3fa87)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Creating volume 709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:43:54 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:43:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:55 devstack sudo[98451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 1073741824
Jul 07 22:43:55 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:43:55 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 0.881s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:55 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481
Jul 07 22:43:55 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:56 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 1073741824" returned: 0 in 1.125s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:56 devstack sudo[98473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767
Jul 07 22:43:56 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:56 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62.797325f9-a9ab-419a-8dd9-f2fd652c9481" returned: 0 in 0.725s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-797325f9-a9ab-419a-8dd9-f2fd652c9481" released by "_delete_snapshot" :: held 3.421s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" released by "delete_snapshot" :: held 3.456s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['b3b5a4a7-2c26-400a-b879-ff1dbfaffaff', '3b9fcf6f-3af2-492f-a9ee-e7ceeb53f969', '0c3fce0b-ee63-4dcd-9494-c7d58cebfd0e', 'f301d808-52b3-40ec-bad7-a5719462fc8d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:43:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Delete snapshot completed successfully.
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ccd69097-00a2-458f-906e-84ed8a915b87 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-797325f9-a9ab-419a-8dd9-f2fd652c9481-delete_snapshot" released by "delete_snapshot" :: held 3.730s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:56 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] <== create_volume: return (2015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.582s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20f83b21-7cb6-479f-8f40-ea21136ea854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad9b43a-a619-4677-a7aa-2d3726b17b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[92803719-4a1e-4243-b7e4-3daab8ee7ab8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Volume volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 (709f0d9f-d12c-40bd-b5f9-ec0d5b932767): created successfully
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad9b43a-a619-4677-a7aa-2d3726b17b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (a1c540b3-12bf-49a4-8118-4630ab32faac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:43:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ddd92b28-e76c-4993-9151-f188c7d76d82 tempest-GroupSnapshotsTest-523578347 None] Created volume successfully.
Jul 07 22:43:57 devstack sudo[98511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3
Jul 07 22:43:57 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3291eecd-3096-4806-ad35-70a3a741cb04 tempest-GroupSnapshotsTest-523578347 None] Update group completed successfully.
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-f0520803-064a-45e6-a9ed-8866c2be0a62-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f0520803-064a-45e6-a9ed-8866c2be0a62-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" acquired by "delete_volume" :: waited 0.043s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fcca53-beac-4807-b9a9-723d5cc6a475]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:43:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b6c1af19-0db6-46b7-9036-562730cbdbff tempest-GroupSnapshotsTest-523578347 None] Update group completed successfully.
Jul 07 22:43:58 devstack sudo[98517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:58 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:58 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3" returned: 0 in 1.248s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.307s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:43:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-6a07b015-b0b6-4a8c-8767-d07378678ce3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62aa15c7-37cc-489e-ac87-c45f11ad4152', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:43:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-08ff375b-01a4-4372-9f48-6a252fbd1758 req-f824694d-4b5f-4df4-8919-54d03a1eccc4 tempest-AttachVolumeNegativeTest-1688201570 None] attachment_update completed successfully.
Jul 07 22:43:58 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.931s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:43:58 devstack sudo[98527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62
Jul 07 22:43:58 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:43:59 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d11e8651-4890-40a9-a19d-1bfde02a34fe tempest-GroupSnapshotsTest-523578347 None] Update group completed successfully.
Jul 07 22:43:59 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root
Jul 07 22:43:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f0520803-064a-45e6-a9ed-8866c2be0a62" returned: 0 in 0.997s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:43:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f0520803-064a-45e6-a9ed-8866c2be0a62" released by "delete_volume" :: held 2.031s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:43:59 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['9f4ab361-bc03-465b-8e68-816f037682ea', '035ae6f3-4fa8-4abd-8ff2-5245b75cb893', '762e1f29-5713-4dd0-881b-f1edcc288972', '7a425f28-58ff-469e-9d3c-21edb7430f69'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:00 devstack sudo[98539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:00 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ad215831-51ff-448a-96c3-57412e5c90a5 tempest-GroupSnapshotsTest-523578347 None] Update group completed successfully.
Jul 07 22:44:00 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.887s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleted volume successfully.
Jul 07 22:44:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b11e8402-51a5-462f-b804-5395412e0343 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f0520803-064a-45e6-a9ed-8866c2be0a62-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (8c590024-4819-438e-98bf-e46b9c347afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df37049-f629-4500-a663-b942bab43308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df37049-f629-4500-a663-b942bab43308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-75928510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ea500-88af-4abf-970f-d3cb66c0bea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:01Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73419db-eb59-4ec3-955f-0039718a5c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73419db-eb59-4ec3-955f-0039718a5c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e2935-9e7c-4c73-ba5f-b49fc8ffacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (706e2935-9e7c-4c73-ba5f-b49fc8ffacd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38ea500-88af-4abf-970f-d3cb66c0bea7', 'volume_name': 'volume-f38ea500-88af-4abf-970f-d3cb66c0bea7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33ea504-c004-4143-a9b0-44407ab2f2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b33ea504-c004-4143-a9b0-44407ab2f2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f1697b-85da-4b80-a3f4-13cf348467ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:01 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume f38ea500-88af-4abf-970f-d3cb66c0bea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38ea500-88af-4abf-970f-d3cb66c0bea7', 'volume_size': 1}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-75928510',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38ea500-88af-4abf-970f-d3cb66c0bea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:01Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Creating volume f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:01 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:44:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:01 devstack sudo[98550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 1073741824
Jul 07 22:44:01 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:02 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 1073741824" returned: 0 in 0.943s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] GroupSnapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: creating.
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:02 devstack sudo[98556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:02 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Group snapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: creating. {{(pid=88152) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:02 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 0.681s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.642s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Creating offline snapshot 3a787917-547e-4192-9a1e-82bb4fa183f1 of volume 88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f1697b-85da-4b80-a3f4-13cf348467ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38ea500-88af-4abf-970f-d3cb66c0bea7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb585eea-8daf-4876-bbff-b53f680842b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[851de812-70e8-4ea1-b44f-954093619f38]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:02 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Volume volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 (f38ea500-88af-4abf-970f-d3cb66c0bea7): created successfully
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb585eea-8daf-4876-bbff-b53f680842b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (8c590024-4819-438e-98bf-e46b9c347afa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d072fdb9-cf52-4880-b519-a4773e8b10d9 tempest-VolumesSnapshotTestJSON-1737740172 None] Created volume successfully.
Jul 07 22:44:03 devstack sudo[98559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e
Jul 07 22:44:03 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:03 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e" returned: 0 in 0.813s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:03 devstack sudo[98564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 1G
Jul 07 22:44:03 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-b3699280-0392-422d-be32-9a145ae42e1d req-da66cbbf-0359-4ab1-83e2-57d56f402755 tempest-AttachVolumeNegativeTest-1688201570 None] Terminate volume connection completed successfully.
Jul 07 22:44:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-b3699280-0392-422d-be32-9a145ae42e1d req-da66cbbf-0359-4ab1-83e2-57d56f402755 tempest-AttachVolumeNegativeTest-1688201570 None] Deleting attachment 62aa15c7-37cc-489e-ac87-c45f11ad4152. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:44:04 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 1G" returned: 0 in 0.937s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88edc3a1-3491-407f-bf15-eb1487d4597e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:04 devstack sudo[98573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88edc3a1-3491-407f-bf15-eb1487d4597e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1
Jul 07 22:44:04 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:05 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88edc3a1-3491-407f-bf15-eb1487d4597e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1" returned: 0 in 0.762s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:05 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:05 devstack sudo[98579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1
Jul 07 22:44:05 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:06 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1" returned: 0 in 0.723s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:06 devstack sudo[98584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info
Jul 07 22:44:06 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:07 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:07 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:07 devstack sudo[98587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info
Jul 07 22:44:07 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:07 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.info" returned: 0 in 0.677s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.839s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Creating offline snapshot 543f50a3-9b10-42b1-a1d5-f6db1defa572 of volume 709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9141ca6-6d03-4934-87d0-6ab5b6b82a56]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:07 devstack sudo[98593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767
Jul 07 22:44:07 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:08 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" returned: 0 in 1.113s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:08 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 1G
Jul 07 22:44:08 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:10 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 1G" returned: 0 in 1.186s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:10 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572
Jul 07 22:44:10 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:10 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572" returned: 0 in 0.771s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:10 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:10 devstack sudo[98630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572
Jul 07 22:44:10 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:11 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572" returned: 0 in 0.694s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:11 devstack sudo[98633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info
Jul 07 22:44:11 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:12 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:12 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:12 devstack sudo[98636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info
Jul 07 22:44:12 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:13 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.info" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.350s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.769s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Creating offline snapshot f7ee3b45-3f7f-4707-821f-023771013c2f of volume f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[496150a0-f722-46c2-997c-d8c71e5f4147]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d13bba77-ff1b-47cf-90af-8266e76a82c6 tempest-GroupSnapshotsTest-523578347 None] group_snapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: created successfully
Jul 07 22:44:13 devstack sudo[98639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:13 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:13 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] group_snapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: deleting
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 0.876s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:14 devstack sudo[98645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f 1G
Jul 07 22:44:14 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] group_snapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: deleting {{(pid=88152) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-3a787917-547e-4192-9a1e-82bb4fa183f1" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-3a787917-547e-4192-9a1e-82bb4fa183f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Deleting offline snapshot 3a787917-547e-4192-9a1e-82bb4fa183f1 of volume 88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] snapshot_file for this snap is: volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb454476-8e5a-4e1c-9c83-4bee523c9cec]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:14 devstack sudo[98647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1
Jul 07 22:44:14 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:14 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f 1G" returned: 0 in 0.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-6a07b015-b0b6-4a8c-8767-d07378678ce3-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:15 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:15 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-6a07b015-b0b6-4a8c-8767-d07378678ce3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-quobyte-6a07b015-b0b6-4a8c-8767-d07378678ce3" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-6a07b015-b0b6-4a8c-8767-d07378678ce3" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:15 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1" returned: 0 in 0.927s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88edc3a1-3491-407f-bf15-eb1487d4597e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b100befc-6762-4dcf-b71a-b35439348c53]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3508633-36d6-4574-b652-33bd7acab5e4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:15 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3
Jul 07 22:44:15 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:15 devstack sudo[98658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e
Jul 07 22:44:15 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:15 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:15 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f is being set with open permissions: ugo+rw
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:15 devstack sudo[98665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:15 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:15 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3" returned: 0 in 0.832s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[98673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3
Jul 07 22:44:16 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e" returned: 0 in 0.855s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[98675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1
Jul 07 22:44:16 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 0.664s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[98678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info
Jul 07 22:44:16 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6a07b015-b0b6-4a8c-8767-d07378678ce3" returned: 0 in 0.741s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-6a07b015-b0b6-4a8c-8767-d07378678ce3" released by "delete_volume" :: held 1.629s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:16 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1" returned: 0 in 0.747s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[98684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1
Jul 07 22:44:16 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Created reservations ['67818c4f-bc1c-4e88-a8f6-f86fea848ddd', 'ac31c81b-9aeb-492e-ae6a-6895b9be54c4', '9e81f5fe-9411-4616-94e2-be9f40553bd3', '66bb62c5-f9c2-4cb2-a582-e5c9dfd5102a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:16 devstack sudo[98686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:16 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:17 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info" returned: 0 in 0.740s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:17 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info is being set with open permissions: ugo+rw
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:17 devstack sudo[98689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info
Jul 07 22:44:17 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-24814fd6-68cb-4ffe-967b-acee26d1929a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-24814fd6-68cb-4ffe-967b-acee26d1929a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-quobyte-24814fd6-68cb-4ffe-967b-acee26d1929a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:17 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e.3a787917-547e-4192-9a1e-82bb4fa183f1" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-24814fd6-68cb-4ffe-967b-acee26d1929a" acquired by "delete_volume" :: waited 0.050s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-3a787917-547e-4192-9a1e-82bb4fa183f1" released by "_delete_snapshot" :: held 3.430s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" released by "delete_snapshot" :: held 3.459s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee91c923-23cd-4014-bb5f-8f7fff04c929]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:17 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.712s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Deleted volume successfully.
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-543f50a3-9b10-42b1-a1d5-f6db1defa572" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bff03be-2f33-429e-b57f-bda2022ba8af tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-6a07b015-b0b6-4a8c-8767-d07378678ce3-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-543f50a3-9b10-42b1-a1d5-f6db1defa572" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Deleting offline snapshot 543f50a3-9b10-42b1-a1d5-f6db1defa572 of volume 709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] snapshot_file for this snap is: volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e034c983-46e2-4553-aa68-d6482144959f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:17 devstack sudo[98693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a
Jul 07 22:44:17 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:17 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572
Jul 07 22:44:17 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:18 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.info" returned: 0 in 0.765s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.971s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:18 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5ac98a27-8be1-49c4-910d-33d11399d323 tempest-VolumesSnapshotTestJSON-1737740172 None] Create snapshot completed successfully
Jul 07 22:44:18 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a" returned: 0 in 0.824s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:18 devstack sudo[98704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a
Jul 07 22:44:18 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:18 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[866c5010-9a4b-48a1-bcfb-f78c83a02969]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:18 devstack sudo[98706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767
Jul 07 22:44:18 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-24814fd6-68cb-4ffe-967b-acee26d1929a" returned: 0 in 0.680s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-24814fd6-68cb-4ffe-967b-acee26d1929a" released by "delete_volume" :: held 1.563s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Created reservations ['0c1b7823-0387-471a-9ab8-176ae5ea5109', '7213b6d1-4569-4a82-8098-e5bf78c1fff2', '09677814-caf8-4b59-8539-7eadcd58b5d6', 'c73fb9e9-4b59-4fb4-ada1-65f880bc702d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:19 devstack sudo[98712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:19 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" returned: 0 in 0.842s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:19 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572
Jul 07 22:44:19 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (46de5586-b325-4e1e-97c3-f781acc09eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a995d1-f603-44df-b968-adb9f6e5dbb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15a995d1-f603-44df-b968-adb9f6e5dbb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-124850297',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e020306b-635f-4188-85f5-1c9d8a750d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='122ede9e277645e68f2edb44db66aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f7ee3b45-3f7f-4707-821f-023771013c2f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:19Z,use_quota=True,user_id='723b476fcccb4ba28a860cf870bc1ca7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfca3b8-ed89-4387-9196-8aeb83b171c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfca3b8-ed89-4387-9196-8aeb83b171c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b8f04e-e5ba-4e3d-84b4-8f99683620f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b8f04e-e5ba-4e3d-84b4-8f99683620f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e020306b-635f-4188-85f5-1c9d8a750d48', 'volume_name': 'volume-e020306b-635f-4188-85f5-1c9d8a750d48', 'volume_size': 1, 'snapshot_id': 'f7ee3b45-3f7f-4707-821f-023771013c2f'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70df37a3-bc4b-4495-aed5-c919bbfeee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70df37a3-bc4b-4495-aed5-c919bbfeee5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c540d0d-2a76-4772-82f9-e3ddce2569b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:19 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Volume e020306b-635f-4188-85f5-1c9d8a750d48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e020306b-635f-4188-85f5-1c9d8a750d48', 'volume_size': 1, 'snapshot_id': 'f7ee3b45-3f7f-4707-821f-023771013c2f'}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f-e020306b-635f-4188-85f5-1c9d8a750d48" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f-e020306b-635f-4188-85f5-1c9d8a750d48" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Creating volume e020306b-635f-4188-85f5-1c9d8a750d48 from snapshot f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] snapshot: f7ee3b45-3f7f-4707-821f-023771013c2f, volume: e020306b-635f-4188-85f5-1c9d8a750d48,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c11649-b59e-4e99-a284-84e9b1b7ae20]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:19 devstack sudo[98716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:19 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-85158f16-7826-463f-a9e4-9e70815d43ff-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-85158f16-7826-463f-a9e4-9e70815d43ff-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:20 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.756s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "cinder-quobyte-85158f16-7826-463f-a9e4-9e70815d43ff" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Deleted volume successfully.
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8397aba7-ace4-495f-8710-ee8d522dd367 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-24814fd6-68cb-4ffe-967b-acee26d1929a-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-85158f16-7826-463f-a9e4-9e70815d43ff" acquired by "delete_volume" :: waited 0.031s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f3e33-af43-4aa0-be39-6aa20f08580a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:20 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff
Jul 07 22:44:20 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:20 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572" returned: 0 in 0.864s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:20 devstack sudo[98724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572
Jul 07 22:44:20 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:20 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 0.996s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f38ea500-88af-4abf-970f-d3cb66c0bea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f359be63-43d2-4ef1-ab0d-d4ac4a8a960f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:20 devstack sudo[98729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:20 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:20 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff" returned: 0 in 0.851s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:20 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767.543f50a3-9b10-42b1-a1d5-f6db1defa572" returned: 0 in 0.712s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:20 devstack sudo[98735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff
Jul 07 22:44:20 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-543f50a3-9b10-42b1-a1d5-f6db1defa572" released by "_delete_snapshot" :: held 3.318s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" released by "delete_snapshot" :: held 3.341s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:21 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1287348991 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1287348991, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:21 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1287348991 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1287348991, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['2661afcb-def4-4cc9-84b0-fc17483d7077', 'a448db1a-6bdd-46fa-b5ed-a59b0d3ea54d', '98d24632-6d4c-402b-add5-ab6290058f35', '0317f08e-b3f2-4c97-b0d4-98b5b4aff4f3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['7dcf8e5e-4638-4736-951c-fb7f2f0c7995', '31de8cd4-4489-48c6-bc3d-bdb6828f6b72', '2480f886-7f6e-4413-a3d2-a8e3660bf3ec', 'c42078e8-b799-4a6b-8bcd-a82a18ae3c48'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8b16a0c9-63e6-4cc0-aaa8-dd5f52356ca6 tempest-GroupSnapshotsTest-523578347 None] group_snapshot 2cacfcc4-b71f-4721-bd96-1309aade9210: deleted successfully
Jul 07 22:44:21 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 0.835s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:21 devstack sudo[98741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48
Jul 07 22:44:21 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:21 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-85158f16-7826-463f-a9e4-9e70815d43ff" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-quobyte-85158f16-7826-463f-a9e4-9e70815d43ff" released by "delete_volume" :: held 1.596s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Created reservations ['f400d8b3-fad7-49cb-8591-9878febc93e9', '627e3160-b9e8-41f8-99a9-26024c8546cb', '6451a612-13c0-4cb1-b390-bf76f51a6c7b', '6e3b120c-ccf7-4669-b648-0e96f9f901ca'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:21 devstack sudo[98743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:21 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c39cbf-364f-4af0-973d-3903bb71292d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:22 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:22 devstack sudo[98748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767
Jul 07 22:44:22 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.791s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Deleted volume successfully.
Jul 07 22:44:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3d2fcb78-4053-41f3-bff8-da06f7bdd328 tempest-AttachVolumeNegativeTest-1688201570 None] Lock "cinder-85158f16-7826-463f-a9e4-9e70815d43ff-delete_volume" released by "delete_volume" :: held 2.745s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:24 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" returned: 0 in 1.848s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:24 devstack sudo[98761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767
Jul 07 22:44:24 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:25 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" returned: 0 in 1.242s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-709f0d9f-d12c-40bd-b5f9-ec0d5b932767" released by "delete_volume" :: held 3.209s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" acquired by "delete_volume" :: waited 0.044s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc43fc3-620c-4f75-874d-1a02a36cc8c5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:25 devstack sudo[98769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e
Jul 07 22:44:25 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:27 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48" returned: 0 in 6.079s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a32e1-b873-41df-bc8f-ffe1d74818f0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:27 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e" returned: 0 in 2.125s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:27 devstack sudo[98779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e
Jul 07 22:44:27 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:27 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:27 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:28 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-88edc3a1-3491-407f-bf15-eb1487d4597e" returned: 0 in 1.013s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-88edc3a1-3491-407f-bf15-eb1487d4597e" released by "delete_volume" :: held 3.268s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=116,cinder:SELECT=107,cinder:INSERT=32,cinder:DELETE=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=118,cinder:UPDATE=112,cinder:INSERT=22,cinder:DELETE=9 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['d432b15c-c359-4158-a928-a9ee075922a4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:28 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:28 devstack cinder-volume[88152]: WARNING cinder.quota [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1287348991 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1287348991, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 1.291s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7, size 1024.00 MB, duration 6.08 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:44:28 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Converted 1024.00 MB image at 168.42 MB/s
Jul 07 22:44:28 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 is being set with open permissions: ugo+rw
Jul 07 22:44:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:29 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48
Jul 07 22:44:29 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['66947e27-0f06-4853-bb24-6f218ebc1cdc', '8ec0fb13-628a-44bf-88b5-991a8a3fc55a', '2f21f823-7cb5-41c3-bfdb-6f34262cbb22', 'a75721ac-45db-4229-93a0-635be73c2859'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Created reservations ['0225d663-7fe5-4e1a-ab66-a34830b5543b', 'bec0d45e-beb8-418d-88de-68d4e2d0e61a', 'b00ab0ae-7ab0-4a02-b18a-0b1abbcb4be0', 'b28b48ce-3132-4771-a07b-e57b79ade10a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:29 devstack sudo[98790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:29 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:29 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48" returned: 0 in 0.935s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" released by "_copy_volume_from_snapshot" :: held 10.257s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f-e020306b-635f-4188-85f5-1c9d8a750d48" released by "_create_volume_from_snapshot" :: held 10.297s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.329s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c540d0d-2a76-4772-82f9-e3ddce2569b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e020306b-635f-4188-85f5-1c9d8a750d48', 'volume_size': 1, 'snapshot_id': 'f7ee3b45-3f7f-4707-821f-023771013c2f'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398012e-8524-4d1e-9d03-1d14490ebf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Volume volume-e020306b-635f-4188-85f5-1c9d8a750d48 (e020306b-635f-4188-85f5-1c9d8a750d48): created successfully
Jul 07 22:44:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2398012e-8524-4d1e-9d03-1d14490ebf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Flow 'volume_create_manager' (46de5586-b325-4e1e-97c3-f781acc09eca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9698ad67-8c14-46c3-8a45-6847ab1f891c tempest-VolumesSnapshotTestJSON-1737740172 None] Created volume successfully.
Jul 07 22:44:30 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.823s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:30 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b0aedfb4-a780-4dd7-8dae-0d8572983b53 tempest-GroupSnapshotsTest-523578347 None] Delete group completed successfully.
Jul 07 22:44:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-b378b797-1923-4705-aa03-32ec553e0723 req-c6975335-cd45-4147-af2f-cfcc7f517cc6 tempest-TestMinimumBasicScenario-602261050 None] Terminate volume connection completed successfully.
Jul 07 22:44:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-b378b797-1923-4705-aa03-32ec553e0723 req-c6975335-cd45-4147-af2f-cfcc7f517cc6 tempest-TestMinimumBasicScenario-602261050 None] Deleting attachment 5602e331-d33f-49f1-b564-96172bd2baae. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:44:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3326560f-76db-43ff-9dc0-dac02811ad80 tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1769723791: creating
Jul 07 22:44:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3326560f-76db-43ff-9dc0-dac02811ad80 tempest-GroupSnapshotsTest-523578347 None] Group tempest-GroupSnapshotsTest-Group-1769723791: created successfully
Jul 07 22:44:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3326560f-76db-43ff-9dc0-dac02811ad80 tempest-GroupSnapshotsTest-523578347 None] Create group completed successfully.
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-e020306b-635f-4188-85f5-1c9d8a750d48-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-e020306b-635f-4188-85f5-1c9d8a750d48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62efc38-d81f-474b-86c5-de52ae922325]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:31 devstack sudo[98798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48
Jul 07 22:44:31 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:32 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48" returned: 0 in 0.877s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:32 devstack sudo[98804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48
Jul 07 22:44:32 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (5ca15f4f-53a6-446e-bc73-c6609469cdb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642879be-a93d-401e-b68e-747b7daa2f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642879be-a93d-401e-b68e-747b7daa2f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368382954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d61c110-5f14-4ac0-9dd2-16d832c8328d,host='devstack@QuobyteHD#QuobyteHD',id=9a3e75c2-65d0-442f-afed-183ba447d8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:33Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d25d97-7433-41a8-9779-97b4b1225280),volume_type_id=09d25d97-7433-41a8-9779-97b4b1225280)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe29af-2bf8-4143-84e6-0ee06222f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe29af-2bf8-4143-84e6-0ee06222f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce2766f-6387-4ea2-bd7c-fc80dc63b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ce2766f-6387-4ea2-bd7c-fc80dc63b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3e75c2-65d0-442f-afed-183ba447d8d1', 'volume_name': 'volume-9a3e75c2-65d0-442f-afed-183ba447d8d1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e658bcb-a7b6-41ce-9cc0-a3b48ded53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e658bcb-a7b6-41ce-9cc0-a3b48ded53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf735ac6-6f64-4e2c-ba36-41f1e6d74f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Volume 9a3e75c2-65d0-442f-afed-183ba447d8d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3e75c2-65d0-442f-afed-183ba447d8d1', 'volume_size': 1}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7d61c110-5f14-4ac0-9dd2-16d832c8328d,created_at=2026-07-07T20:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-368382954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7d61c110-5f14-4ac0-9dd2-16d832c8328d,host='devstack@QuobyteHD#QuobyteHD',id=9a3e75c2-65d0-442f-afed-183ba447d8d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cf7afaf760942fab7c9813d6e7b16c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:44:33Z,use_quota=True,user_id='7b12aa818b2047d7931590760b0764d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(09d25d97-7433-41a8-9779-97b4b1225280),volume_type_id=09d25d97-7433-41a8-9779-97b4b1225280)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Creating volume 9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:44:32 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "cinder-d2a617f8-a761-4c18-9fd1-3072d81f4ee1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "cinder-d2a617f8-a761-4c18-9fd1-3072d81f4ee1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack sudo[98807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 1073741824
Jul 07 22:44:33 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e020306b-635f-4188-85f5-1c9d8a750d48" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-e020306b-635f-4188-85f5-1c9d8a750d48" released by "delete_volume" :: held 1.755s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "cinder-quobyte-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "cinder-quobyte-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c97c2e-42b7-4420-9f6d-a30e01a81966]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['d585bca7-f638-4565-87e6-351f64f330a2', '65c88212-9077-4722-9df7-178aad9ad7c9', '665fff2c-acff-414c-ad18-b63b7653fa63', '3b9ae618-7847-4ff2-9fd2-e7957a610099'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1
Jul 07 22:44:33 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack sudo[98811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:33 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-f7ee3b45-3f7f-4707-821f-023771013c2f-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f7ee3b45-3f7f-4707-821f-023771013c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleting offline snapshot f7ee3b45-3f7f-4707-821f-023771013c2f of volume f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] snapshot_file for this snap is: volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0ddae-b56b-443c-8a8b-4a63d737d3aa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:33 devstack sudo[98818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:33 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:33 devstack sudo[98815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:33 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:34 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" returned: 0 in 1.084s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:34 devstack sudo[98825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1
Jul 07 22:44:34 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:34 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.085s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Deleted volume successfully.
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a1a72bd3-f805-4c06-b49f-2801d8d0cc7f tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-e020306b-635f-4188-85f5-1c9d8a750d48-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:34 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 1073741824" returned: 0 in 1.455s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:34 devstack sudo[98827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1
Jul 07 22:44:34 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.242s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:44:35 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 1.377s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f38ea500-88af-4abf-970f-d3cb66c0bea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[361f59e7-aaf2-4b84-ace0-d8e8d124059a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:35 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" returned: 0 in 1.111s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "cinder-quobyte-d2a617f8-a761-4c18-9fd1-3072d81f4ee1" released by "delete_volume" :: held 2.254s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:35 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:35 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Created reservations ['4b971f4a-3e29-43ce-b911-fd216ab85ea0', 'd1b78475-bb14-4543-8bcb-3b6b360c208c', '4f6890c6-762b-4922-8e66-df28ee5c7c73', '6f2badf6-86c9-40a7-83ff-8fce0b17881b'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:35 devstack sudo[98838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:35 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:35 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1" returned: 0 in 1.185s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] <== create_volume: return (2702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.704s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf735ac6-6f64-4e2c-ba36-41f1e6d74f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3e75c2-65d0-442f-afed-183ba447d8d1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3199839-c89c-4ad2-b045-9160f8c59f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:44:35 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Volume volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 (9a3e75c2-65d0-442f-afed-183ba447d8d1): created successfully
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3199839-c89c-4ad2-b045-9160f8c59f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:44:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Flow 'volume_create_manager' (5ca15f4f-53a6-446e-bc73-c6609469cdb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:44:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1c45d476-f69a-4280-8346-02fcf22ac507 tempest-GroupSnapshotsTest-523578347 None] Created volume successfully.
Jul 07 22:44:36 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 1.036s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:36 devstack sudo[98844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:36 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:36 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Deleted volume successfully.
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-da6246dd-f972-4429-bbff-d34d035043f9 tempest-TestMinimumBasicScenario-602261050 None] Lock "cinder-d2a617f8-a761-4c18-9fd1-3072d81f4ee1-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f4ef318a-e08f-43d0-978e-029b83a693fe tempest-BackendsCapabilitiesAdminTestsJSON-1580270663 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.687099456787, 'free_capacity_gb': 1775.687099456787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88152) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 22:44:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a75eaa60-aae4-4615-9658-e14c2c1561f1 tempest-BackendsCapabilitiesAdminTestsJSON-1580270663 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.687099456787, 'free_capacity_gb': 1775.687099456787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88152) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 22:44:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] GroupSnapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: creating.
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Group snapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: creating. {{(pid=88152) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Creating offline snapshot bd402f1a-f811-419f-86f2-ab8bb6cdf351 of volume 9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40c9e1a-8a06-4a94-b2a8-ce5c55cf9658]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:37 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 0.984s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:37 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f
Jul 07 22:44:37 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:37 devstack sudo[98850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1
Jul 07 22:44:37 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:37 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7.f7ee3b45-3f7f-4707-821f-023771013c2f" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f7ee3b45-3f7f-4707-821f-023771013c2f" released by "_delete_snapshot" :: held 4.275s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" released by "delete_snapshot" :: held 4.310s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:38 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1" returned: 0 in 0.872s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:38 devstack sudo[98869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 1G
Jul 07 22:44:38 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['d54154b8-a3d9-4a68-892e-db4ed4371507', '74b47b4c-3d26-4ece-8f64-2502ba6560bf', '80e780da-8d7c-49db-aa83-67a1a6d122cc', '5f34f467-8fde-41e4-9e8a-edff2549287d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Delete snapshot completed successfully.
Jul 07 22:44:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3502ac12-4f13-49f9-baea-0cca6008d4a6 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f7ee3b45-3f7f-4707-821f-023771013c2f-delete_snapshot" released by "delete_snapshot" :: held 4.556s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:39 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 1G" returned: 0 in 1.135s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-f38ea500-88af-4abf-970f-d3cb66c0bea7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:39 devstack sudo[98890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351
Jul 07 22:44:39 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f38ea500-88af-4abf-970f-d3cb66c0bea7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab0668-564b-4254-8c38-fd659217e317]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:39 devstack sudo[98893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:39 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:40 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351" returned: 0 in 1.039s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:40 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:40 devstack sudo[98900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351
Jul 07 22:44:40 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:40 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 1.091s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:40 devstack sudo[98905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7
Jul 07 22:44:40 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:41 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351" returned: 0 in 0.888s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:41 devstack sudo[98908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info
Jul 07 22:44:41 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:41 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f38ea500-88af-4abf-970f-d3cb66c0bea7" returned: 0 in 0.849s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-f38ea500-88af-4abf-970f-d3cb66c0bea7" released by "delete_volume" :: held 2.085s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['12348159-9fb3-47f4-969f-ab93b56e662b', '4f338eae-2240-4148-a7d6-38a4f7543496', '048836a2-97d7-493b-8509-fc8e24270742', '53cd5522-8641-4d70-b862-e296919ee3bf'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:41 devstack sudo[98911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:41 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:41 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:41 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 07 22:44:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:41 devstack sudo[98914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info
Jul 07 22:44:41 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:42 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Deleted volume successfully.
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fde6cd8f-b080-41ea-9916-8d6ccf07ae3c tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-f38ea500-88af-4abf-970f-d3cb66c0bea7-delete_volume" released by "delete_volume" :: held 3.129s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:42 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.info" returned: 0 in 0.789s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.631s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-5f11a31c-af4f-4340-a7ed-c18d3af9e610-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-5f11a31c-af4f-4340-a7ed-c18d3af9e610-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8faa50dd-5896-4fff-ae81-a2708423b146 tempest-GroupSnapshotsTest-523578347 None] group_snapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: created successfully
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8990de8-33b1-47ee-84d0-c5d2bc05bd40]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:43 devstack sudo[98918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610
Jul 07 22:44:43 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: deleting
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: deleting {{(pid=88152) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 07 22:44:43 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610" returned: 0 in 0.868s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:43 devstack sudo[98923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610
Jul 07 22:44:43 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-bd402f1a-f811-419f-86f2-ab8bb6cdf351" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-bd402f1a-f811-419f-86f2-ab8bb6cdf351" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Deleting offline snapshot bd402f1a-f811-419f-86f2-ab8bb6cdf351 of volume 9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] snapshot_file for this snap is: volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60aa56-11d7-462b-97a7-459130f87e96]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:44 devstack sudo[98925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351
Jul 07 22:44:44 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:44 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f11a31c-af4f-4340-a7ed-c18d3af9e610" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-quobyte-5f11a31c-af4f-4340-a7ed-c18d3af9e610" released by "delete_volume" :: held 1.793s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Created reservations ['8ffc2738-25dc-45e7-8ca9-56808adf656c', '9d6b1916-8ae6-4ef6-8fa4-54d8f5c924f6', '3d420e95-5367-44ce-af54-d057e3b8be0e', '4612473a-982c-4d30-bc7d-51dd48da77a6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:44 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351" returned: 0 in 0.985s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3e75c2-65d0-442f-afed-183ba447d8d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:44:44 devstack sudo[98931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:44 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f0b7f-1a5b-468d-8905-c51ec8c34258]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:45 devstack sudo[98933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1
Jul 07 22:44:45 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:45 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:45 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Deleted volume successfully.
Jul 07 22:44:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c90dfc6b-88be-4920-aa4f-6fa9d6712180 tempest-VolumesSnapshotTestJSON-1737740172 None] Lock "cinder-5f11a31c-af4f-4340-a7ed-c18d3af9e610-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:45 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1" returned: 0 in 1.042s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:46 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351
Jul 07 22:44:46 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:46 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351" returned: 0 in 0.971s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:46 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351
Jul 07 22:44:46 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:47 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1.bd402f1a-f811-419f-86f2-ab8bb6cdf351" returned: 0 in 0.809s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-bd402f1a-f811-419f-86f2-ab8bb6cdf351" released by "_delete_snapshot" :: held 3.954s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" released by "delete_snapshot" :: held 3.983s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:47 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-358479007 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-358479007, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:47 devstack cinder-volume[88152]: WARNING cinder.quota [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-358479007 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-358479007, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:47 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] Created reservations ['cfd30df4-937b-4689-bb24-4ae13a6a65e7', 'c4bec42c-b0f7-4a1a-9f0d-a5eb6bcf7dfa', '33d17c5d-9547-4353-919e-9e2fbd1d09bb', 'e0049ece-c37d-4634-9990-4512728decd0'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d004cc0f-3620-4b7b-aa5d-8523aed5ff5b tempest-GroupSnapshotsTest-523578347 None] group_snapshot 268009bf-1e5f-4650-9e33-7b8aa48d6cbe: deleted successfully
Jul 07 22:44:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:44:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:44:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40c4c2-52b6-4f42-b8af-61e94a30c64f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:44:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:49 devstack sudo[98952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1
Jul 07 22:44:49 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:49 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1" returned: 0 in 0.922s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:49 devstack sudo[98957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1
Jul 07 22:44:49 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:50 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9a3e75c2-65d0-442f-afed-183ba447d8d1" returned: 0 in 0.891s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Lock "cinder-quobyte-9a3e75c2-65d0-442f-afed-183ba447d8d1" released by "delete_volume" :: held 1.926s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:44:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Created reservations ['10d23e8a-6d00-4c2c-a614-7cec820f90d5'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:50 devstack cinder-volume[88152]: WARNING cinder.quota [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-358479007 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-358479007, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:44:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Created reservations ['8a7c84bf-4571-44fa-b89e-3acc68db33df', 'f3e3dfc6-ae43-4098-ad77-51c1157f1e53', '7b5717c2-ed13-4258-9be2-a264e38cc19a', '23a406a3-b2ed-4e5f-83d4-2a69a1de70bf'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:44:51 devstack sudo[98962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:44:51 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:44:51 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.873s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:44:51 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:44:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0a85c2c6-438e-4a5e-9aca-eb7c8879fa0c tempest-GroupSnapshotsTest-523578347 None] Delete group completed successfully.
Jul 07 22:45:01 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=65,cinder:UPDATE=80,cinder:INSERT=19,cinder:DELETE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:45:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=62,cinder:INSERT=21,cinder:UPDATE=81,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Flow 'volume_create_manager' (8952475d-6c5b-4689-87b2-0a7c197b70b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f6e3f2-6d48-44d3-917d-bd4cbdb879ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f6e3f2-6d48-44d3-917d-bd4cbdb879ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1664240582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13770af9-0e9e-4325-993f-afeb2b1f0008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e41fa3359406288fef76634a8430c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:05Z,use_quota=True,user_id='a5b09cb9d5184bce9a9805e4cb8f4c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1842e13-b471-4abb-aa70-cfc0acbecef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1842e13-b471-4abb-aa70-cfc0acbecef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c7f946-1b6d-46ac-b61d-6d2907d9d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c7f946-1b6d-46ac-b61d-6d2907d9d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13770af9-0e9e-4325-993f-afeb2b1f0008', 'volume_name': 'volume-13770af9-0e9e-4325-993f-afeb2b1f0008', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019f1a03-06ba-49e2-ba7e-64019813db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019f1a03-06ba-49e2-ba7e-64019813db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd74fbdc-bfa0-44b2-a602-87e2bcd926ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Volume 13770af9-0e9e-4325-993f-afeb2b1f0008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13770af9-0e9e-4325-993f-afeb2b1f0008', 'volume_size': 1}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1664240582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13770af9-0e9e-4325-993f-afeb2b1f0008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f36e41fa3359406288fef76634a8430c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:05Z,use_quota=True,user_id='a5b09cb9d5184bce9a9805e4cb8f4c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Creating volume 13770af9-0e9e-4325-993f-afeb2b1f0008 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:04 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:04 devstack sudo[99012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 1073741824
Jul 07 22:45:04 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:05 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 1073741824" returned: 0 in 1.107s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:06 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008
Jul 07 22:45:06 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:06 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008" returned: 0 in 0.785s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd74fbdc-bfa0-44b2-a602-87e2bcd926ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13770af9-0e9e-4325-993f-afeb2b1f0008', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501eca89-33fd-4399-8896-359fa6312bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:06 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Volume volume-13770af9-0e9e-4325-993f-afeb2b1f0008 (13770af9-0e9e-4325-993f-afeb2b1f0008): created successfully
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (501eca89-33fd-4399-8896-359fa6312bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Flow 'volume_create_manager' (8952475d-6c5b-4689-87b2-0a7c197b70b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cfc01556-7543-4481-97d0-a80e87dc3f87 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Created volume successfully.
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Acquiring lock "cinder-13770af9-0e9e-4325-993f-afeb2b1f0008-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "cinder-13770af9-0e9e-4325-993f-afeb2b1f0008-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Acquiring lock "cinder-quobyte-13770af9-0e9e-4325-993f-afeb2b1f0008" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "cinder-quobyte-13770af9-0e9e-4325-993f-afeb2b1f0008" acquired by "delete_volume" :: waited 0.031s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff55312-a4b3-49b5-a774-28c75bdece30]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:09 devstack sudo[99023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008
Jul 07 22:45:09 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:10 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008" returned: 0 in 1.102s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:10 devstack sudo[99028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008
Jul 07 22:45:10 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:11 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13770af9-0e9e-4325-993f-afeb2b1f0008" returned: 0 in 0.884s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "cinder-quobyte-13770af9-0e9e-4325-993f-afeb2b1f0008" released by "delete_volume" :: held 2.042s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Created reservations ['be92aa30-09d5-4e59-a875-aa3791229d8b', '0a8f6935-2896-45e6-b232-cc114e3637e1', 'de13ea96-73a4-4892-b620-2d32fb2875ec', '5fb753cc-b3fe-45cd-af8f-115f7a0f17d3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:11 devstack sudo[99031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:11 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ce97461-3833-4ae1-9ae9-1c564698f0b4 tempest-GroupsTest-804223104 None] Group tempest-Group1-77357174: creating
Jul 07 22:45:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ce97461-3833-4ae1-9ae9-1c564698f0b4 tempest-GroupsTest-804223104 None] Group tempest-Group1-77357174: created successfully
Jul 07 22:45:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6ce97461-3833-4ae1-9ae9-1c564698f0b4 tempest-GroupsTest-804223104 None] Create group completed successfully.
Jul 07 22:45:12 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.059s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:12 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Deleted volume successfully.
Jul 07 22:45:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-328df4d4-2e45-433a-aab7-cce79d3fb498 tempest-VolumeQuotasNegativeTestJSON-873548573 None] Lock "cinder-13770af9-0e9e-4325-993f-afeb2b1f0008-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1809f36f-c642-480d-bdec-c5f3922778e0 tempest-GroupsTest-804223104 None] Group tempest-Group2-1534414817: creating
Jul 07 22:45:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1809f36f-c642-480d-bdec-c5f3922778e0 tempest-GroupsTest-804223104 None] Group tempest-Group2-1534414817: created successfully
Jul 07 22:45:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1809f36f-c642-480d-bdec-c5f3922778e0 tempest-GroupsTest-804223104 None] Create group completed successfully.
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (af694bed-bece-416a-afd3-19772524847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058ef1a5-964c-4d58-9532-0d77816d6430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (058ef1a5-964c-4d58-9532-0d77816d6430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370700029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c498d654-1f60-40aa-90fe-aef80aeaa284,host='devstack@QuobyteHD#QuobyteHD',id=1de788cf-b43d-4c6e-918e-b4a0123106b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:15Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1423fe8d-3ae1-42b2-a5c5-5ad841e4c8c4),volume_type_id=1423fe8d-3ae1-42b2-a5c5-5ad841e4c8c4)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f5382d-fd68-4542-8ef2-3c9248094501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f5382d-fd68-4542-8ef2-3c9248094501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd68a3d-024c-4ab5-a28a-f059fdee660d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd68a3d-024c-4ab5-a28a-f059fdee660d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de788cf-b43d-4c6e-918e-b4a0123106b7', 'volume_name': 'volume-1de788cf-b43d-4c6e-918e-b4a0123106b7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d8db9b-a7fb-44db-8a00-b0a13685c0c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d8db9b-a7fb-44db-8a00-b0a13685c0c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97dee74b-5c24-4f49-a542-63c704a3936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Volume 1de788cf-b43d-4c6e-918e-b4a0123106b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de788cf-b43d-4c6e-918e-b4a0123106b7', 'volume_size': 1}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c498d654-1f60-40aa-90fe-aef80aeaa284,created_at=2026-07-07T20:45:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370700029',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c498d654-1f60-40aa-90fe-aef80aeaa284,host='devstack@QuobyteHD#QuobyteHD',id=1de788cf-b43d-4c6e-918e-b4a0123106b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:15Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1423fe8d-3ae1-42b2-a5c5-5ad841e4c8c4),volume_type_id=1423fe8d-3ae1-42b2-a5c5-5ad841e4c8c4)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Creating volume 1de788cf-b43d-4c6e-918e-b4a0123106b7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:15 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 1073741824
Jul 07 22:45:15 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:16 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 1073741824" returned: 0 in 1.047s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:16 devstack sudo[99042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7
Jul 07 22:45:16 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:17 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.819s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97dee74b-5c24-4f49-a542-63c704a3936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de788cf-b43d-4c6e-918e-b4a0123106b7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f77ee5-7729-4e6a-baaa-f79a5250dac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Volume volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 (1de788cf-b43d-4c6e-918e-b4a0123106b7): created successfully
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f77ee5-7729-4e6a-baaa-f79a5250dac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (af694bed-bece-416a-afd3-19772524847a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d842f5ca-3e5c-4e63-9e5b-309dd8ceaa22 tempest-GroupsTest-804223104 None] Created volume successfully.
Jul 07 22:45:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Acquiring lock "cinder-quobyte-1de788cf-b43d-4c6e-918e-b4a0123106b7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-1de788cf-b43d-4c6e-918e-b4a0123106b7" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[deea96c1-4db9-4f62-a485-59057d7e1bd8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:18 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7
Jul 07 22:45:18 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:19 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7" returned: 0 in 0.964s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:19 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7
Jul 07 22:45:19 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:20 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1de788cf-b43d-4c6e-918e-b4a0123106b7" returned: 0 in 0.805s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-1de788cf-b43d-4c6e-918e-b4a0123106b7" released by "delete_volume" :: held 1.855s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Created reservations ['8e85eb82-19c3-4b2a-9a3c-bece98476ddc'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:20 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1155024229 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1155024229, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:45:20 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1155024229 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1155024229, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Created reservations ['43b2b82e-021e-4933-b77d-6d6f65ed0b3c', '79aaa17d-1ad8-41e6-85ae-443806b2eea6', '30bc1826-2946-498e-b261-1c36f3f6c8ac', '2497b5a3-ce0a-4da5-8bad-42c70575b1f3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:20 devstack sudo[99054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:20 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Created reservations ['d761c6bc-42ba-4baa-b731-606443282377'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:21 devstack sudo[99057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:21 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:21 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.872s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:21 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8eba1b0c-7ff2-4112-8e67-65469e0c8ab2 tempest-GroupsTest-804223104 None] Delete group completed successfully.
Jul 07 22:45:22 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.820s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:22 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-263e85a1-1108-441b-8699-cfb37daece5c tempest-GroupsTest-804223104 None] Delete group completed successfully.
Jul 07 22:45:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b0dbdbca-5281-4067-a46f-73be8d4fcdd9 tempest-GroupsTest-804223104 None] Group tempest-GroupsTest-Group-707533918: creating
Jul 07 22:45:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b0dbdbca-5281-4067-a46f-73be8d4fcdd9 tempest-GroupsTest-804223104 None] Group tempest-GroupsTest-Group-707533918: created successfully
Jul 07 22:45:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b0dbdbca-5281-4067-a46f-73be8d4fcdd9 tempest-GroupsTest-804223104 None] Create group completed successfully.
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Flow 'volume_create_manager' (36a927d9-ce17-42eb-b89c-5a1498077a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89eaf83-665f-4824-a5f0-5dcbefe21fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b89eaf83-665f-4824-a5f0-5dcbefe21fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1204866752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255201b-10f6-4c2d-90f1-4284308d4f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fff532668540eba11df90309f94526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:25Z,use_quota=True,user_id='4f823abac1aa49289cc987b79135aea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36cb6b6-44c8-42dc-b053-6a4913a1bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36cb6b6-44c8-42dc-b053-6a4913a1bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d34ea2-4bc3-406a-9d1c-0737e139dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d34ea2-4bc3-406a-9d1c-0737e139dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3255201b-10f6-4c2d-90f1-4284308d4f2c', 'volume_name': 'volume-3255201b-10f6-4c2d-90f1-4284308d4f2c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7321db-fbe5-4a15-8a4a-4bb2ed0fbf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae7321db-fbe5-4a15-8a4a-4bb2ed0fbf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6566af96-3d3e-411d-8033-fae33a984976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Volume 3255201b-10f6-4c2d-90f1-4284308d4f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3255201b-10f6-4c2d-90f1-4284308d4f2c', 'volume_size': 1}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1204866752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3255201b-10f6-4c2d-90f1-4284308d4f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16fff532668540eba11df90309f94526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:25Z,use_quota=True,user_id='4f823abac1aa49289cc987b79135aea2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Creating volume 3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:25 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:25 devstack sudo[99061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c 1073741824
Jul 07 22:45:25 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (150654a0-51f3-4119-b73a-11eba96adfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d8dd3-1fdb-4a2c-9e7c-0ac2345d4689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809d8dd3-1fdb-4a2c-9e7c-0ac2345d4689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999854041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,host='devstack@QuobyteHD#QuobyteHD',id=1c4f1b57-5324-4a78-b435-58db208531bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:26Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecb9c25-c530-46de-8218-699b0ee127ff),volume_type_id=3ecb9c25-c530-46de-8218-699b0ee127ff)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1293286a-2848-4066-8785-9dc0f8b1ccb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1293286a-2848-4066-8785-9dc0f8b1ccb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1493f54b-cbaf-48d4-94dd-3e00d020740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1493f54b-cbaf-48d4-94dd-3e00d020740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c4f1b57-5324-4a78-b435-58db208531bc', 'volume_name': 'volume-1c4f1b57-5324-4a78-b435-58db208531bc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0fe06f-2243-4343-906f-04decdef9709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0fe06f-2243-4343-906f-04decdef9709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9513a2-8817-4013-933a-697d70716d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Volume 1c4f1b57-5324-4a78-b435-58db208531bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c4f1b57-5324-4a78-b435-58db208531bc', 'volume_size': 1}
Jul 07 22:45:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:26 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c 1073741824" returned: 0 in 1.112s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:26 devstack sudo[99067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c
Jul 07 22:45:26 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:27 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.782s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,created_at=2026-07-07T20:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999854041',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,host='devstack@QuobyteHD#QuobyteHD',id=1c4f1b57-5324-4a78-b435-58db208531bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:26Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecb9c25-c530-46de-8218-699b0ee127ff),volume_type_id=3ecb9c25-c530-46de-8218-699b0ee127ff)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Creating volume 1c4f1b57-5324-4a78-b435-58db208531bc {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:27 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6566af96-3d3e-411d-8033-fae33a984976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3255201b-10f6-4c2d-90f1-4284308d4f2c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:27 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc 1073741824
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71b9885-d704-4524-a3b2-2c1f180d8e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:27 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Volume volume-3255201b-10f6-4c2d-90f1-4284308d4f2c (3255201b-10f6-4c2d-90f1-4284308d4f2c): created successfully
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d71b9885-d704-4524-a3b2-2c1f180d8e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Flow 'volume_create_manager' (36a927d9-ce17-42eb-b89c-5a1498077a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-26796370-e5d1-4a90-a38e-17029781f9f6 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Created volume successfully.
Jul 07 22:45:28 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc 1073741824" returned: 0 in 1.233s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:28 devstack sudo[99077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc
Jul 07 22:45:28 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Flow 'volume_create_manager' (83364d36-45f8-4e4a-a162-83aebbd79e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1d9305-573f-4d47-896d-de9297c1a762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1d9305-573f-4d47-896d-de9297c1a762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425186523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3043a3077c450bb16fb714ff8cc3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:29Z,use_quota=True,user_id='9e88f6f55ac04a8bb4ca66299e9c9485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53dfdd2-2ef5-4af8-b1a1-0981a62df5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d53dfdd2-2ef5-4af8-b1a1-0981a62df5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88011f4-2ac9-4444-8f36-9f3a5157e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88011f4-2ac9-4444-8f36-9f3a5157e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07', 'volume_name': 'volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05fba8f-250f-4b52-8df3-0beada854945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05fba8f-250f-4b52-8df3-0beada854945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaab082b-77b7-43dd-9bfc-a3309d4de979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume 8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07', 'volume_size': 1}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Flow 'volume_create_manager' (fb17f9c2-a9c6-4c1e-ae65-6b07aef850c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa3db3b-39c8-44ac-9c12-fbdc582fc3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa3db3b-39c8-44ac-9c12-fbdc582fc3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-612978699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f603d1-830c-4c90-a9f3-4243f4cfc9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3043a3077c450bb16fb714ff8cc3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:30Z,use_quota=True,user_id='9e88f6f55ac04a8bb4ca66299e9c9485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95da7e-52a7-46ae-af57-ef8cf1fa619c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f95da7e-52a7-46ae-af57-ef8cf1fa619c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684d977-f62b-4131-ab30-6eaf9a62a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5684d977-f62b-4131-ab30-6eaf9a62a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9f603d1-830c-4c90-a9f3-4243f4cfc9af', 'volume_name': 'volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b9a316-8b9f-4164-bf4a-64e4a013a646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b9a316-8b9f-4164-bf4a-64e4a013a646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac389f03-f49e-491d-b1d0-e983b0edaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume d9f603d1-830c-4c90-a9f3-4243f4cfc9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af', 'volume_size': 1}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc" returned: 0 in 1.014s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.310s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.004s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Creating offline snapshot 149dcb68-5a59-4730-9209-3603490402db of volume 3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9513a2-8817-4013-933a-697d70716d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c4f1b57-5324-4a78-b435-58db208531bc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c312beb-99e3-426c-8e89-22999bb29ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb7a63-a0fd-46eb-aef0-55df00d12685]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Volume volume-1c4f1b57-5324-4a78-b435-58db208531bc (1c4f1b57-5324-4a78-b435-58db208531bc): created successfully
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c312beb-99e3-426c-8e89-22999bb29ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (150654a0-51f3-4119-b73a-11eba96adfb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7a560f43-b521-4be1-9b98-7575d520d47d tempest-GroupsTest-804223104 None] Created volume successfully.
Jul 07 22:45:30 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c
Jul 07 22:45:30 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:30 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c" returned: 0 in 1.001s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:30 devstack sudo[99085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db 1G
Jul 07 22:45:30 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (24d0d67a-0b77-485f-af6e-e850a66bde64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702fc6c5-ff60-43e3-afdc-086ce0ae749d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702fc6c5-ff60-43e3-afdc-086ce0ae749d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465803427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,host='devstack@QuobyteHD#QuobyteHD',id=c0ffb360-f836-4952-b9db-ab97b658e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:31Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecb9c25-c530-46de-8218-699b0ee127ff),volume_type_id=3ecb9c25-c530-46de-8218-699b0ee127ff)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ce740c-acbb-46c0-9ade-34f11ad16145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ce740c-acbb-46c0-9ade-34f11ad16145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad093319-5783-494b-b688-3b89aaaab4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad093319-5783-494b-b688-3b89aaaab4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ffb360-f836-4952-b9db-ab97b658e45e', 'volume_name': 'volume-c0ffb360-f836-4952-b9db-ab97b658e45e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9b4079-59ff-44ba-99a7-5a3ac055be88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd9b4079-59ff-44ba-99a7-5a3ac055be88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22940017-2f0b-46fc-a492-275e98dd94f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:31 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Volume c0ffb360-f836-4952-b9db-ab97b658e45e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ffb360-f836-4952-b9db-ab97b658e45e', 'volume_size': 1}
Jul 07 22:45:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:32 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db 1G" returned: 0 in 1.228s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255201b-10f6-4c2d-90f1-4284308d4f2c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:32 devstack sudo[99091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255201b-10f6-4c2d-90f1-4284308d4f2c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db
Jul 07 22:45:32 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:33 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3255201b-10f6-4c2d-90f1-4284308d4f2c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db" returned: 0 in 0.908s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:33 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db is being set with open permissions: ugo+rw
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:33 devstack sudo[99096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db
Jul 07 22:45:33 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:33 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db" returned: 0 in 0.752s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:33 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info
Jul 07 22:45:33 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:33 devstack sudo[99101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:33 devstack sudo[99101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:34 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info" returned: 0 in 0.988s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:34 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info is being set with open permissions: ugo+rw
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:34 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info
Jul 07 22:45:34 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:34 devstack sudo[99101]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.985s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:45:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:45:35 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.info" returned: 0 in 0.874s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.874s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.274s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1425186523',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3043a3077c450bb16fb714ff8cc3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:29Z,use_quota=True,user_id='9e88f6f55ac04a8bb4ca66299e9c9485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Creating volume 8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:35 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:35 devstack sudo[99110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 1073741824
Jul 07 22:45:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-12639be0-d0f0-43f6-a6a1-aefc799d5269 tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Create snapshot completed successfully
Jul 07 22:45:35 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:36 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 1073741824" returned: 0 in 1.235s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "cinder-149dcb68-5a59-4730-9209-3603490402db-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-149dcb68-5a59-4730-9209-3603490402db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:37 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07
Jul 07 22:45:37 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" acquired by "delete_snapshot" :: waited 0.049s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "cinder-quobyte-149dcb68-5a59-4730-9209-3603490402db" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-149dcb68-5a59-4730-9209-3603490402db" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Deleting offline snapshot 149dcb68-5a59-4730-9209-3603490402db of volume 3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] snapshot_file for this snap is: volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adc7155-aa0e-4b87-9b58-20cfba8e80fa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:37 devstack sudo[99120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db
Jul 07 22:45:37 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Flow 'volume_create_manager' (e1eb8adc-ab7b-491b-90fc-4080b2935e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070cce9-954e-4fde-9040-0411fe6982a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2070cce9-954e-4fde-9040-0411fe6982a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1607550771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60331b1c-f0a8-4914-857b-dc543f068b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b4da8a560343a09f8fcebb631fb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:38Z,use_quota=True,user_id='06fb9c23215b44d89dfeaff804515fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eba444f-407a-4f83-83e6-6e694bf1c61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eba444f-407a-4f83-83e6-6e694bf1c61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a55d71-7d8a-48dd-a589-3189b4ac54cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:37 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a55d71-7d8a-48dd-a589-3189b4ac54cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '60331b1c-f0a8-4914-857b-dc543f068b7a', 'volume_name': 'volume-60331b1c-f0a8-4914-857b-dc543f068b7a', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f5bfb0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f3819-0358-425e-befb-dcd0492f6151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7f3819-0358-425e-befb-dcd0492f6151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f38bbe-67c9-4e72-8c5b-821ced08cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Volume 60331b1c-f0a8-4914-857b-dc543f068b7a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-60331b1c-f0a8-4914-857b-dc543f068b7a', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f5bfb0>}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Trying to clone 60331b1c-f0a8-4914-857b-dc543f068b7a from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:45:38 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" returned: 0 in 1.085s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] <== create_volume: return (2392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.396s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.301s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-612978699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9f603d1-830c-4c90-a9f3-4243f4cfc9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3043a3077c450bb16fb714ff8cc3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:30Z,use_quota=True,user_id='9e88f6f55ac04a8bb4ca66299e9c9485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Creating volume d9f603d1-830c-4c90-a9f3-4243f4cfc9af {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:38 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaab082b-77b7-43dd-9bfc-a3309d4de979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack sudo[99131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af 1073741824
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd334d-dd75-477b-b99d-3c9de5002e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:38 devstack sudo[99131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 (8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07): created successfully
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfd334d-dd75-477b-b99d-3c9de5002e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Flow 'volume_create_manager' (83364d36-45f8-4e4a-a162-83aebbd79e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-933d689f-a319-442b-b9c7-9dda8c104855 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Created volume successfully.
Jul 07 22:45:38 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db" returned: 0 in 1.080s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3255201b-10f6-4c2d-90f1-4284308d4f2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[257ed1b9-b2a9-42f1-8c45-2598134ad043]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:38 devstack sudo[99135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c
Jul 07 22:45:38 devstack sudo[99135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:45:38 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fed726-24af-4b18-8f77-a6589e824fbe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:38 devstack sudo[99138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD
Jul 07 22:45:38 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:39 devstack sudo[99135]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c" returned: 0 in 0.895s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:39 devstack sudo[99148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db
Jul 07 22:45:39 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:39 devstack sudo[99131]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af 1073741824" returned: 0 in 1.199s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:39 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af
Jul 07 22:45:39 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:39 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a is fetched for user 06fb9c23215b44d89dfeaff804515fc4. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[58029970-5288-450d-93de-46d7568187c8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:39 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD
Jul 07 22:45:39 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:40 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db" returned: 0 in 0.906s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:40 devstack sudo[99163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db
Jul 07 22:45:40 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:40 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] <== create_volume: return (2160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.741s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,created_at=2026-07-07T20:45:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-465803427',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=47f2e15b-9fd0-48cd-aabf-e63151febeaf,host='devstack@QuobyteHD#QuobyteHD',id=c0ffb360-f836-4952-b9db-ab97b658e45e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6943b5065894e929ea3347a493be915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:31Z,use_quota=True,user_id='91294dec038a44d8b531ff875d1e994d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ecb9c25-c530-46de-8218-699b0ee127ff),volume_type_id=3ecb9c25-c530-46de-8218-699b0ee127ff)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Creating volume c0ffb360-f836-4952-b9db-ab97b658e45e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:40 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac389f03-f49e-491d-b1d0-e983b0edaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91531249-4c22-48f7-b86a-e533439eb8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:40 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e 1073741824
Jul 07 22:45:40 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Volume volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af (d9f603d1-830c-4c90-a9f3-4243f4cfc9af): created successfully
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91531249-4c22-48f7-b86a-e533439eb8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Flow 'volume_create_manager' (fb17f9c2-a9c6-4c1e-ae65-6b07aef850c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5f2fa6ce-d669-4c9e-8af9-3d4d356a4b39 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Created volume successfully.
Jul 07 22:45:40 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD" returned: 0 in 0.860s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:40 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c.149dcb68-5a59-4730-9209-3603490402db" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-149dcb68-5a59-4730-9209-3603490402db" released by "_delete_snapshot" :: held 3.787s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" released by "delete_snapshot" :: held 3.842s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Created reservations ['863e5cb8-bc97-4b79-949a-c543dd701d0a', '7832613e-a9e3-4dfa-87e8-c2b09564f67e', '315dbfd8-66ea-4543-a369-27e6a4301fa5', '6c074b2c-d987-4d02-9774-395a69a5ad45'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Delete snapshot completed successfully.
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3e6f3de2-0f78-4087-9fcd-98883d8aa76c tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-149dcb68-5a59-4730-9209-3603490402db-delete_snapshot" released by "delete_snapshot" :: held 4.049s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:41 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "cinder-3255201b-10f6-4c2d-90f1-4284308d4f2c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e 1073741824" returned: 0 in 1.072s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-3255201b-10f6-4c2d-90f1-4284308d4f2c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:41 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e
Jul 07 22:45:41 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab353652-1276-4b07-8fe3-b0667ee34527]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:41 devstack sudo[99178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c
Jul 07 22:45:41 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:42 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e" returned: 0 in 0.893s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] <== create_volume: return (2063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.827s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1607550771',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60331b1c-f0a8-4914-857b-dc543f068b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b4da8a560343a09f8fcebb631fb97f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:45:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:45:38Z,use_quota=True,user_id='06fb9c23215b44d89dfeaff804515fc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Creating volume 60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:45:42 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:42 devstack sudo[99184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1073741824
Jul 07 22:45:42 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22940017-2f0b-46fc-a492-275e98dd94f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ffb360-f836-4952-b9db-ab97b658e45e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741ea5b9-9afb-433f-9d02-7ca92a7fe91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:42 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Volume volume-c0ffb360-f836-4952-b9db-ab97b658e45e (c0ffb360-f836-4952-b9db-ab97b658e45e): created successfully
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (741ea5b9-9afb-433f-9d02-7ca92a7fe91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Flow 'volume_create_manager' (24d0d67a-0b77-485f-af6e-e850a66bde64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5cfd6abb-6cb2-475e-9742-0f1ae4beaf95 tempest-GroupsTest-804223104 None] Created volume successfully.
Jul 07 22:45:42 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c" returned: 0 in 0.999s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:42 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c
Jul 07 22:45:42 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:43 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3255201b-10f6-4c2d-90f1-4284308d4f2c" returned: 0 in 0.799s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-quobyte-3255201b-10f6-4c2d-90f1-4284308d4f2c" released by "delete_volume" :: held 1.884s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Created reservations ['69c976ce-5942-45e3-856d-3878bf5ec43c', 'e7e234a0-9984-47d1-9a63-ccba74fef6c9', '2e9d0ee7-0b3b-469c-afc5-8a1af8297611', '47f9ef79-d7ed-4cdd-a87e-16582a5c22ea'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1073741824" returned: 0 in 1.270s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:43 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:43 devstack sudo[99204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:43 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:43 devstack sudo[99206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:45:43 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-de98d729-76b9-4cb6-a192-e5d4b7ba39cc tempest-GroupsTest-804223104 None] Update group completed successfully.
Jul 07 22:45:44 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 0.922s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.314s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:44 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.024s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Deleted volume successfully.
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-11b17d35-f32a-40b6-92fd-d3da796757ce tempest-VolumeSnapshotQuotasNegativeTestJSON-2056405556 None] Lock "cinder-3255201b-10f6-4c2d-90f1-4284308d4f2c-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Attempting download of 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 60331b1c-f0a8-4914-857b-dc543f068b7a. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43287b-4e03-427c-9eff-372c3334520d]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:44 devstack sudo[99215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4
Jul 07 22:45:44 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-85f70447-7cb9-4484-b3e8-06b59237ab3f tempest-GroupsTest-804223104 None] Update group completed successfully.
Jul 07 22:45:45 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4" returned: 0 in 0.917s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:45 devstack sudo[99220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4
Jul 07 22:45:45 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:46 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4" returned: 1 in 0.974s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_e11ye4p4' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:45:46 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98bf197-0e27-41a0-b38c-8024d36278fb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:46 devstack sudo[99224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD
Jul 07 22:45:46 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Acquiring lock "cinder-quobyte-1c4f1b57-5324-4a78-b435-58db208531bc" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-1c4f1b57-5324-4a78-b435-58db208531bc" acquired by "delete_volume" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7cc1f8-c1de-4cda-99b3-fb7aca490055]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:47 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc
Jul 07 22:45:47 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:47 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD" returned: 0 in 1.169s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] 3d79ec3d-7feb-4185-b960-5d4caffe8b9a was qcow2, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:45:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:47 devstack sudo[99248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:45:47 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:48 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc" returned: 0 in 1.418s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:48 devstack sudo[99282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc
Jul 07 22:45:48 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:49 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1c4f1b57-5324-4a78-b435-58db208531bc" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-1c4f1b57-5324-4a78-b435-58db208531bc" released by "delete_volume" :: held 2.317s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Acquiring lock "cinder-quobyte-c0ffb360-f836-4952-b9db-ab97b658e45e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-c0ffb360-f836-4952-b9db-ab97b658e45e" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba9ffe5-ca0b-4a23-8345-d4cbf528bd27]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:49 devstack sudo[99316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e
Jul 07 22:45:49 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:50 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e" returned: 0 in 0.960s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:50 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e
Jul 07 22:45:50 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:50 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 3.060s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:50 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_ix_hrnq6devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:45:50 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Converted 112.00 MB image at 36.58 MB/s
Jul 07 22:45:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:51 devstack sudo[99326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1G
Jul 07 22:45:51 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:51 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c0ffb360-f836-4952-b9db-ab97b658e45e" returned: 0 in 1.103s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "cinder-quobyte-c0ffb360-f836-4952-b9db-ab97b658e45e" released by "delete_volume" :: held 2.147s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:45:51 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Created reservations ['1ece1b6b-1bdc-4f75-80e3-08d16aecb6d2'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:51 devstack cinder-volume[88152]: WARNING cinder.quota [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1722778082 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1722778082, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:45:51 devstack cinder-volume[88152]: WARNING cinder.quota [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1722778082 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1722778082, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Created reservations ['7574efb6-db72-4971-9b21-f536f61b6bf7', '8c40954d-fc7f-4b74-96b5-e60392c32513', '2f4183c7-453d-4a8f-85fa-150e5c86563c', '473086f0-28cf-4087-b993-9d7d209a4d69'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Created reservations ['3b0289f1-d005-4508-9f7d-d66970efb2e3', 'ed9f4036-49fc-4b2f-b6f5-0978dd43147f', '875a644f-33c6-43a2-a25d-6c56cdc87cb9', 'd7914405-c6f6-486a-a867-a7225374af3f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:45:52 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a 1G" returned: 0 in 1.415s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a13d4c-fff7-410e-a5cf-f1e2a4ededa2]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:45:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:52 devstack sudo[99332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:45:52 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:52 devstack sudo[99333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:45:52 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:53 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.523s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:45:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7d7e86ed-e6ac-4ff8-a493-a03f1e75c808 tempest-GroupsTest-804223104 None] Delete group completed successfully.
Jul 07 22:45:54 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 1.836s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:45:54 devstack sudo[99339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:45:54 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:45:55 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 1 in 1.057s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Downloaded image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 60331b1c-f0a8-4914-857b-dc543f068b7a successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a for user 06fb9c23215b44d89dfeaff804515fc4 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Marking volume 60331b1c-f0a8-4914-857b-dc543f068b7a as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Copying metadata from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a to 60331b1c-f0a8-4914-857b-dc543f068b7a. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Creating volume glance metadata for volume 60331b1c-f0a8-4914-857b-dc543f068b7a backed by image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13f38bbe-67c9-4e72-8c5b-821ced08cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60331b1c-f0a8-4914-857b-dc543f068b7a', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f5bfb0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3197c5c-e847-4f8a-8db3-7505e7c699d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:45:55 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Volume volume-60331b1c-f0a8-4914-857b-dc543f068b7a (60331b1c-f0a8-4914-857b-dc543f068b7a): created successfully
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3197c5c-e847-4f8a-8db3-7505e7c699d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:45:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Flow 'volume_create_manager' (e1eb8adc-ab7b-491b-90fc-4080b2935e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:45:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ea927eb0-c2d6-4a24-bb33-6350684aff3e tempest-TestShelveInstance-1775621835 None] Created volume successfully.
Jul 07 22:46:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2c3a8831-27e1-4665-aba8-b29472296764 tempest-GroupsV320Test-1237917840 None] Group tempest-GroupsV320Test-Group-107465818: creating
Jul 07 22:46:01 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=81,cinder:INSERT=27,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2c3a8831-27e1-4665-aba8-b29472296764 tempest-GroupsV320Test-1237917840 None] Group tempest-GroupsV320Test-Group-107465818: created successfully
Jul 07 22:46:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2c3a8831-27e1-4665-aba8-b29472296764 tempest-GroupsV320Test-1237917840 None] Create group completed successfully.
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=87,cinder:SELECT=78,cinder:INSERT=22,cinder:DELETE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Created reservations ['650030b8-2027-4dba-84be-c8a4a18ef010'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:03 devstack sudo[99400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:46:03 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:04 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.008s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:04 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f5e1e1b7-100b-4688-93d1-051ecfdec0fd tempest-GroupsV320Test-1237917840 None] Delete group completed successfully.
Jul 07 22:46:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7144ab2-d0da-4bec-a7e1-118057729cf6]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:05 devstack sudo[99429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:46:05 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:06 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:06 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:46:06 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:07 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 1 in 1.076s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:46:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.979s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-60331b1c-f0a8-4914-857b-dc543f068b7a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5ed0176b-7174-4fe4-b69d-9784c68db626', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:46:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-f71894be-2d66-4461-b34f-7b1b2d4c98bf req-ef74c619-479b-40ca-8a7c-0bbc4a30907a tempest-TestShelveInstance-1775621835 None] attachment_update completed successfully.
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Flow 'volume_create_manager' (d830945a-1540-48c2-8e86-9fe51eb920b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661bf4e-2da6-4288-8d5d-8b47fffc076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f661bf4e-2da6-4288-8d5d-8b47fffc076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-117235988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d34419-f124-46e4-a90b-31d095b3d90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def6f96d9054076aeb9c314106630d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:17Z,use_quota=True,user_id='e94b590436b04c89b290b3c2f964bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e84328d-0665-4a0e-a1d6-5b785401b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e84328d-0665-4a0e-a1d6-5b785401b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb586180-3ada-4ff2-80da-2a864ded8e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb586180-3ada-4ff2-80da-2a864ded8e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d34419-f124-46e4-a90b-31d095b3d90a', 'volume_name': 'volume-55d34419-f124-46e4-a90b-31d095b3d90a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7375b0d-c62d-4b0c-9496-1caa44d172be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7375b0d-c62d-4b0c-9496-1caa44d172be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b8cd13-63c1-4344-94e2-14b51dcfa613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume 55d34419-f124-46e4-a90b-31d095b3d90a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d34419-f124-46e4-a90b-31d095b3d90a', 'volume_size': 1}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-117235988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d34419-f124-46e4-a90b-31d095b3d90a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def6f96d9054076aeb9c314106630d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:17Z,use_quota=True,user_id='e94b590436b04c89b290b3c2f964bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Creating volume 55d34419-f124-46e4-a90b-31d095b3d90a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:17 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:17 devstack sudo[99887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a 1073741824
Jul 07 22:46:17 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:17 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:46:18 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a 1073741824" returned: 0 in 1.056s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:18 devstack sudo[99895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a
Jul 07 22:46:18 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:20 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a" returned: 0 in 1.778s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] <== create_volume: return (2897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.899s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.197s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b8cd13-63c1-4344-94e2-14b51dcfa613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d34419-f124-46e4-a90b-31d095b3d90a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31549d2c-8ee7-40b5-be3d-529bc0322b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[37260883-addf-4b3c-9fa8-73c9b932652d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume volume-55d34419-f124-46e4-a90b-31d095b3d90a (55d34419-f124-46e4-a90b-31d095b3d90a): created successfully
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31549d2c-8ee7-40b5-be3d-529bc0322b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Flow 'volume_create_manager' (d830945a-1540-48c2-8e86-9fe51eb920b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d4caaf90-47d9-45af-a44e-b7d7615f1553 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Created volume successfully.
Jul 07 22:46:20 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07
Jul 07 22:46:20 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "cinder-55d34419-f124-46e4-a90b-31d095b3d90a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "cinder-55d34419-f124-46e4-a90b-31d095b3d90a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "cinder-quobyte-55d34419-f124-46e4-a90b-31d095b3d90a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "cinder-quobyte-55d34419-f124-46e4-a90b-31d095b3d90a" acquired by "delete_volume" :: waited 0.036s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cf98cd-808b-4f8e-8abf-cdb419bbb899]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:21 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a
Jul 07 22:46:21 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:22 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" returned: 0 in 1.682s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.760s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cbcc4963-d373-45b0-98dd-4351bf49f5b8', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:46:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-86360646-5b3d-49ae-bb19-00a2d619073a req-71043400-0b3d-4acb-a41e-dae4c4ab0478 tempest-TestServerVolumeAttachmentScenario-1882512864 None] attachment_update completed successfully.
Jul 07 22:46:23 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a" returned: 0 in 1.783s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:23 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a
Jul 07 22:46:23 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:24 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-55d34419-f124-46e4-a90b-31d095b3d90a" returned: 0 in 1.188s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "cinder-quobyte-55d34419-f124-46e4-a90b-31d095b3d90a" released by "delete_volume" :: held 3.095s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Created reservations ['8bd628f8-7431-4593-b3a7-eab965256d26', '48310230-c0f3-40c2-8051-10e9a0ef4dc4', 'e6868372-8ae1-4608-a0fe-6950fc9a515f', '5dee505a-10a4-4666-8215-825e4d6dfb87'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:24 devstack sudo[99923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:46:24 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:26 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Flow 'volume_create_manager' (c9067064-5914-44f3-a693-f3d063a206d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1329a01-c092-4f7d-b90d-c8e6bb211863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.391s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Deleted volume successfully.
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1329a01-c092-4f7d-b90d-c8e6bb211863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1485116390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132d25ab-f421-4963-be31-972ec683ce6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def6f96d9054076aeb9c314106630d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='e94b590436b04c89b290b3c2f964bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb58050-965b-4b33-b55f-34f0d870c6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb58050-965b-4b33-b55f-34f0d870c6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0e21d7-1271-4256-a4a0-a5499458da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a0e21d7-1271-4256-a4a0-a5499458da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132d25ab-f421-4963-be31-972ec683ce6e', 'volume_name': 'volume-132d25ab-f421-4963-be31-972ec683ce6e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f6b4a9-85ae-445a-a58d-73d89fe0a7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f6b4a9-85ae-445a-a58d-73d89fe0a7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d39d307-f2f0-4376-bd89-b9576b08fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume 132d25ab-f421-4963-be31-972ec683ce6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132d25ab-f421-4963-be31-972ec683ce6e', 'volume_size': 1}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1485116390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132d25ab-f421-4963-be31-972ec683ce6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2def6f96d9054076aeb9c314106630d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:26Z,use_quota=True,user_id='e94b590436b04c89b290b3c2f964bb06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Creating volume 132d25ab-f421-4963-be31-972ec683ce6e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:26 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e575028-3b40-49d6-a6df-6be5cb3460b5 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "cinder-55d34419-f124-46e4-a90b-31d095b3d90a-delete_volume" released by "delete_volume" :: held 5.056s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:26 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e 1073741824
Jul 07 22:46:26 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:27 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e 1073741824" returned: 0 in 1.601s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:28 devstack sudo[99935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e
Jul 07 22:46:28 devstack sudo[99935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:29 devstack sudo[99935]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e" returned: 0 in 1.003s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] <== create_volume: return (2833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.841s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d39d307-f2f0-4376-bd89-b9576b08fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132d25ab-f421-4963-be31-972ec683ce6e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218d08e0-8d2e-4288-8c19-cffd46415c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Volume volume-132d25ab-f421-4963-be31-972ec683ce6e (132d25ab-f421-4963-be31-972ec683ce6e): created successfully
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218d08e0-8d2e-4288-8c19-cffd46415c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Flow 'volume_create_manager' (c9067064-5914-44f3-a693-f3d063a206d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a9718f50-95ee-4f61-98ed-fd191f139b69 tempest-VolumeQuotasAdminTestJSON-1554891415 None] Created volume successfully.
Jul 07 22:46:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-53c665cc-db82-496d-bcd2-88dc2a93bc7a tempest-VolumeQuotasAdminTestJSON-782767982 None] Transfer volume completed successfully.
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Acquiring lock "cinder-132d25ab-f421-4963-be31-972ec683ce6e-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "cinder-132d25ab-f421-4963-be31-972ec683ce6e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Acquiring lock "cinder-quobyte-132d25ab-f421-4963-be31-972ec683ce6e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "cinder-quobyte-132d25ab-f421-4963-be31-972ec683ce6e" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bf7443-9473-48e9-b483-8b4a4ca53b2f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:31 devstack sudo[99942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e
Jul 07 22:46:31 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:32 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:32 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e
Jul 07 22:46:32 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:33 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-132d25ab-f421-4963-be31-972ec683ce6e" returned: 0 in 0.681s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "cinder-quobyte-132d25ab-f421-4963-be31-972ec683ce6e" released by "delete_volume" :: held 1.558s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Created reservations ['e0e5c313-62e2-4583-8001-f58c06ed097e', '72470d42-92dd-4e78-ac41-4ed976b04f2e', '5b347de8-ccdf-4a71-a436-12849376c7de', 'e4c6b7c3-d8c9-43c7-9c92-928147068623'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:33 devstack sudo[99977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:46:33 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:33 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:46:33 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:34 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.952s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Deleted volume successfully.
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53ef8a51-11f5-4b11-a6a5-b1c20eb280a5 tempest-VolumeQuotasAdminTestJSON-282425058 None] Lock "cinder-132d25ab-f421-4963-be31-972ec683ce6e-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d57fa-eda9-45cd-bbcb-22e65e989a44]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:34 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af
Jul 07 22:46:34 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:35 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.191s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:46:35 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00fccc2d-8e4b-42a2-87b5-95a3e1f3df15', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:46:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-ccbfd48b-8b75-4fc4-902c-fe5dce23767d req-14085038-d5b5-45e5-b733-ff4e4d328afa tempest-TestServerVolumeAttachmentScenario-1882512864 None] attachment_update completed successfully.
Jul 07 22:46:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-2ce18fc7-ab87-417e-a128-0bf01778aea3 req-17b4db7c-10ad-4068-bcff-eae9d8c5ed54 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Terminate volume connection completed successfully.
Jul 07 22:46:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-2ce18fc7-ab87-417e-a128-0bf01778aea3 req-17b4db7c-10ad-4068-bcff-eae9d8c5ed54 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Deleting attachment 00fccc2d-8e4b-42a2-87b5-95a3e1f3df15. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:46:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c14a370b-fcd4-47d0-882a-2a340c29ebb5 req-d517c2db-2b6d-4495-9b44-52a60226df22 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Terminate volume connection completed successfully.
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-c14a370b-fcd4-47d0-882a-2a340c29ebb5 req-d517c2db-2b6d-4495-9b44-52a60226df22 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Deleting attachment cbcc4963-d373-45b0-98dd-4351bf49f5b8. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (909c92ac-7db7-4bdd-b018-8138e823973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d0cbb-5fc6-4efb-b39c-36be5d772186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b43d0cbb-5fc6-4efb-b39c-36be5d772186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267459375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afc6d01-420d-4489-ac95-5f57a752dc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:50Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d5b5a8-8a3d-4079-9616-81c4a2489dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0d5b5a8-8a3d-4079-9616-81c4a2489dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feab3aa9-3705-453c-a7a5-c0fff07c1461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feab3aa9-3705-453c-a7a5-c0fff07c1461) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1afc6d01-420d-4489-ac95-5f57a752dc19', 'volume_name': 'volume-1afc6d01-420d-4489-ac95-5f57a752dc19', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89efe6f7-8081-4b38-9bd1-b04eb3040b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89efe6f7-8081-4b38-9bd1-b04eb3040b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e86f35e-2923-478e-9007-395b80da88ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Volume 1afc6d01-420d-4489-ac95-5f57a752dc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1afc6d01-420d-4489-ac95-5f57a752dc19', 'volume_size': 1}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267459375',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1afc6d01-420d-4489-ac95-5f57a752dc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:50Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Creating volume 1afc6d01-420d-4489-ac95-5f57a752dc19 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:49 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:46:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:49 devstack sudo[100176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 1073741824
Jul 07 22:46:49 devstack sudo[100176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:51 devstack sudo[100176]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 1073741824" returned: 0 in 1.226s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:51 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19
Jul 07 22:46:51 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:52 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19" returned: 0 in 1.087s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] <== create_volume: return (2382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.394s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e86f35e-2923-478e-9007-395b80da88ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1afc6d01-420d-4489-ac95-5f57a752dc19', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbcf040-ea5d-4e5f-bcaf-77d7d493cdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Volume volume-1afc6d01-420d-4489-ac95-5f57a752dc19 (1afc6d01-420d-4489-ac95-5f57a752dc19): created successfully
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfbcf040-ea5d-4e5f-bcaf-77d7d493cdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (909c92ac-7db7-4bdd-b018-8138e823973a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cb5aab1d-4847-4ac8-9069-902113f0e75e tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:46:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b14207b1-22ab-45ac-9b8b-8cfd66cd261d tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19" by "attach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b14207b1-22ab-45ac-9b8b-8cfd66cd261d tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19" acquired by "attach_volume" :: waited 0.037s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b14207b1-22ab-45ac-9b8b-8cfd66cd261d tempest-VolumesActionsTest-246993091 None] Attaching volume 1afc6d01-420d-4489-ac95-5f57a752dc19 to instance 620ae630-2d01-4cb7-9011-87b705f30d04 at mountpoint /dev/vdb on host None.
Jul 07 22:46:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b14207b1-22ab-45ac-9b8b-8cfd66cd261d tempest-VolumesActionsTest-246993091 None] Attach volume completed successfully.
Jul 07 22:46:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b14207b1-22ab-45ac-9b8b-8cfd66cd261d tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19" released by "attach_volume" :: held 0.610s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-fd3e9ddd-2911-40e1-8c8e-e646b0a4b895 req-56aa2eaf-3eb8-4034-b048-dc5f4294f523 tempest-TestShelveInstance-1775621835 None] Terminate volume connection completed successfully.
Jul 07 22:46:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-fd3e9ddd-2911-40e1-8c8e-e646b0a4b895 req-56aa2eaf-3eb8-4034-b048-dc5f4294f523 tempest-TestShelveInstance-1775621835 None] Deleting attachment 5ed0176b-7174-4fe4-b69d-9784c68db626. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:46:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Terminate volume connection completed successfully.
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" by "detach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" acquired by "detach_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Detaching volume 1afc6d01-420d-4489-ac95-5f57a752dc19 from instance 620ae630-2d01-4cb7-9011-87b705f30d04.
Jul 07 22:46:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Detach volume completed successfully.
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c9d3f8fe-02c3-4762-adf3-d99ecf3ba0f9 tempest-VolumesActionsTest-210127709 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Flow 'volume_create_manager' (40f87e4c-c7b2-42d6-a702-f810d38466a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8b73ba-600d-454e-8cd8-42995e8efbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8b73ba-600d-454e-8cd8-42995e8efbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1205137430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c98ef-7d02-4610-add1-fa6f89bc0168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e15659652de4aa7844355fbf1bbd3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:57Z,use_quota=True,user_id='14816830f0714de28226e35af588172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd221610-6506-4314-bb87-17604bb29916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd221610-6506-4314-bb87-17604bb29916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b88a99-1a06-4dce-a80d-9931d017aac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b88a99-1a06-4dce-a80d-9931d017aac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223c98ef-7d02-4610-add1-fa6f89bc0168', 'volume_name': 'volume-223c98ef-7d02-4610-add1-fa6f89bc0168', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c202627-4932-482e-863c-9e84b88986f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c202627-4932-482e-863c-9e84b88986f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df551484-c981-481d-af6c-5357083a6c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Volume 223c98ef-7d02-4610-add1-fa6f89bc0168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223c98ef-7d02-4610-add1-fa6f89bc0168', 'volume_size': 1}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:46:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1205137430',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c98ef-7d02-4610-add1-fa6f89bc0168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e15659652de4aa7844355fbf1bbd3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:46:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:46:57Z,use_quota=True,user_id='14816830f0714de28226e35af588172e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Creating volume 223c98ef-7d02-4610-add1-fa6f89bc0168 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:46:56 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5d250ba0-56f1-4869-adcc-d7466828bddf tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" by "detach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:57 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 1073741824
Jul 07 22:46:57 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5d250ba0-56f1-4869-adcc-d7466828bddf tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5d250ba0-56f1-4869-adcc-d7466828bddf tempest-VolumesActionsTest-246993091 None] Volume detach called, but volume not attached.
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5d250ba0-56f1-4869-adcc-d7466828bddf tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-quobyte-1afc6d01-420d-4489-ac95-5f57a752dc19" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:46:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "cinder-quobyte-1afc6d01-420d-4489-ac95-5f57a752dc19" acquired by "delete_volume" :: waited 0.052s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:46:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f8771-e5cc-4cea-9bf2-60a906a79dde]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:46:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:58 devstack sudo[100232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19
Jul 07 22:46:58 devstack sudo[100232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:58 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 1073741824" returned: 0 in 1.502s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:58 devstack sudo[100238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168
Jul 07 22:46:58 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:59 devstack sudo[100232]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19" returned: 0 in 1.129s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:46:59 devstack sudo[100264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19
Jul 07 22:46:59 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:46:59 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168" returned: 0 in 1.041s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.646s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df551484-c981-481d-af6c-5357083a6c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223c98ef-7d02-4610-add1-fa6f89bc0168', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f75657-2396-46be-8012-ce75eb423120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:46:59 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Volume volume-223c98ef-7d02-4610-add1-fa6f89bc0168 (223c98ef-7d02-4610-add1-fa6f89bc0168): created successfully
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f75657-2396-46be-8012-ce75eb423120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:46:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Flow 'volume_create_manager' (40f87e4c-c7b2-42d6-a702-f810d38466a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:46:59 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6a8d72ac-2686-41d6-ac41-1ca9aec70427 tempest-AbsoluteLimitsTests-1055461047 None] Created volume successfully.
Jul 07 22:47:00 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1afc6d01-420d-4489-ac95-5f57a752dc19" returned: 0 in 0.955s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "cinder-quobyte-1afc6d01-420d-4489-ac95-5f57a752dc19" released by "delete_volume" :: held 2.178s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Created reservations ['212004fd-4bde-4449-ae12-075c8987ba80', '395ff47a-0276-471c-a1f9-c255fdd5a121', '2a648d29-d606-4350-971b-974c79ff220d', 'c30829d2-522a-41c0-b9f5-c040ab98a3a2'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Acquiring lock "cinder-223c98ef-7d02-4610-add1-fa6f89bc0168-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "cinder-223c98ef-7d02-4610-add1-fa6f89bc0168-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Acquiring lock "cinder-quobyte-223c98ef-7d02-4610-add1-fa6f89bc0168" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "cinder-quobyte-223c98ef-7d02-4610-add1-fa6f89bc0168" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:00 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:00 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf6cf25-4ac2-4f96-ba73-9417098767c2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:00 devstack sudo[100306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168
Jul 07 22:47:00 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:01 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.851s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Deleted volume successfully.
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cf9c1f18-147d-401b-9bf8-9766d359d43e tempest-VolumesActionsTest-246993091 None] Lock "cinder-1afc6d01-420d-4489-ac95-5f57a752dc19-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:01 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:01 devstack sudo[100316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168
Jul 07 22:47:01 devstack sudo[100316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae03cdc2-175e-4b0e-bead-5b802927f54d]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:01 devstack sudo[100325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:47:01 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "cinder-d9f603d1-830c-4c90-a9f3-4243f4cfc9af-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-d9f603d1-830c-4c90-a9f3-4243f4cfc9af-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "cinder-quobyte-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-quobyte-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[02578bd1-f893-40d6-8f82-5b2bbc59aa20]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:02 devstack sudo[100330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af
Jul 07 22:47:02 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:02 devstack sudo[100316]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-223c98ef-7d02-4610-add1-fa6f89bc0168" returned: 0 in 1.020s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "cinder-quobyte-223c98ef-7d02-4610-add1-fa6f89bc0168" released by "delete_volume" :: held 1.982s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Created reservations ['3d2a3607-2d96-41de-9357-bcb30e7685b3', 'b225cf63-b6fe-4fcf-b0c9-cd8c1998f8bd', '4e19a4cc-1a49-4575-b0b9-3e1aefc86f7d', 'fd1460d9-7f55-437a-8bb4-3d326aaad63b'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:02 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:02 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:02 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 1.082s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:02 devstack sudo[100346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:47:02 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:02 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" returned: 0 in 1.022s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:03 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af
Jul 07 22:47:03 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:03 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.178s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:03 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Deleted volume successfully.
Jul 07 22:47:03 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=61,cinder:UPDATE=51,cinder:DELETE=6,cinder:INSERT=9 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:47:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-40054ca0-682b-400a-95df-025d40cc14c5 tempest-AbsoluteLimitsTests-1055461047 None] Lock "cinder-223c98ef-7d02-4610-add1-fa6f89bc0168-delete_volume" released by "delete_volume" :: held 3.490s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:04 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" returned: 0 in 1.066s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-quobyte-d9f603d1-830c-4c90-a9f3-4243f4cfc9af" released by "delete_volume" :: held 2.145s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:04 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 1 in 1.438s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.607s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Created reservations ['1af51925-04ea-423d-b6bd-bb5af03e5cfb', '5c5da3d7-fa75-4379-a726-c581e5aae52b', '61d18b1c-749e-4d7c-bece-634895bbf89f', '35526e8f-6fc9-4434-8283-858c021be163'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-60331b1c-f0a8-4914-857b-dc543f068b7a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'feffabec-13a3-447b-a012-4a12c114da7e', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:04 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:04 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-d10753f2-8694-47bc-a464-18dfbf67f7c9 req-f8438ce8-0d0a-4075-8826-8ac563637bbd tempest-TestShelveInstance-1775621835 None] attachment_update completed successfully.
Jul 07 22:47:05 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.987s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Deleted volume successfully.
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a549e97b-907a-4e49-8aa8-fe13709fa516 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-d9f603d1-830c-4c90-a9f3-4243f4cfc9af-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "cinder-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "cinder-quobyte-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-quobyte-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1dfce-fb1b-4ee9-8016-c95712f4d7b0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:05 devstack sudo[100379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07
Jul 07 22:47:05 devstack sudo[100379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:06 devstack sudo[100379]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" returned: 0 in 0.880s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:06 devstack sudo[100385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07
Jul 07 22:47:06 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:07 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" returned: 0 in 0.764s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-quobyte-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07" released by "delete_volume" :: held 1.689s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Created reservations ['43695a84-7e89-42a4-b9ed-58a26a5b93ae', 'e57f8333-2e42-4e8d-a7a6-ab5bddbabb6f', '4559d8db-e26c-418c-9ccb-8dace40948b0', '51809feb-d7e4-4f7b-97cd-094cf36b3598'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:07 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:07 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:08 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.774s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:08 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Deleted volume successfully.
Jul 07 22:47:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b74de4ba-847b-4bfe-9f20-d00c75ed2d23 tempest-TestServerVolumeAttachmentScenario-1882512864 None] Lock "cinder-8dcf0f60-bac4-4f8e-b825-e4ed9cfbcb07-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Flow 'volume_create_manager' (99a1afc2-d639-4931-8eda-499de11b3cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc23bc5-d4b8-4308-81dd-c9e12101330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc23bc5-d4b8-4308-81dd-c9e12101330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-73167624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c85d5e-a487-44d5-9fc4-6490efd8ad72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f60b8eadbb4269be00e0faef972cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:10Z,use_quota=True,user_id='39d09a66887d471c90bbe3dd70c37059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93d07fa-1aa5-4c1a-96e3-930b64b9aa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93d07fa-1aa5-4c1a-96e3-930b64b9aa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1cc18-ae31-4e33-bd0e-f568cbccace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b1cc18-ae31-4e33-bd0e-f568cbccace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c85d5e-a487-44d5-9fc4-6490efd8ad72', 'volume_name': 'volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38dbef7-6795-4cae-a9c9-3077e61bcd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38dbef7-6795-4cae-a9c9-3077e61bcd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9168da47-12da-49d7-ac65-cb66dbf5d423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Volume 72c85d5e-a487-44d5-9fc4-6490efd8ad72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72', 'volume_size': 1}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-73167624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c85d5e-a487-44d5-9fc4-6490efd8ad72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f60b8eadbb4269be00e0faef972cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:10Z,use_quota=True,user_id='39d09a66887d471c90bbe3dd70c37059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Creating volume 72c85d5e-a487-44d5-9fc4-6490efd8ad72 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:10 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:10 devstack sudo[100393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 1073741824
Jul 07 22:47:10 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:11 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 1073741824" returned: 0 in 1.188s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:11 devstack sudo[100399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72
Jul 07 22:47:11 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (c51561c4-cc40-42b0-b334-8555d84a84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1c263f-6bf6-4dc4-9f5e-7cfbaebe9368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1c263f-6bf6-4dc4-9f5e-7cfbaebe9368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461687310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6298cb-afea-4bda-ab48-2781ccdc3e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:12Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fbea5a-36b8-40c5-ad65-62f4a55c2c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44fbea5a-36b8-40c5-ad65-62f4a55c2c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f94bfd-b760-47dc-ad32-a1192b256bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f94bfd-b760-47dc-ad32-a1192b256bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab6298cb-afea-4bda-ab48-2781ccdc3e5a', 'volume_name': 'volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0803367d-1e91-463f-a099-1b176c46226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0803367d-1e91-463f-a099-1b176c46226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91e4131-d641-4700-b54b-445e45e1cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Volume ab6298cb-afea-4bda-ab48-2781ccdc3e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a', 'volume_size': 1}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:12 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72" returned: 0 in 0.959s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.305s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-461687310',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab6298cb-afea-4bda-ab48-2781ccdc3e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:12Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Creating volume ab6298cb-afea-4bda-ab48-2781ccdc3e5a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:12 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:12 devstack sudo[100403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a 1073741824
Jul 07 22:47:12 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9168da47-12da-49d7-ac65-cb66dbf5d423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e7c6ce-de25-4e15-8e82-2de96f425ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Volume volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 (72c85d5e-a487-44d5-9fc4-6490efd8ad72): created successfully
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e7c6ce-de25-4e15-8e82-2de96f425ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Flow 'volume_create_manager' (99a1afc2-d639-4931-8eda-499de11b3cdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4934b541-eb29-4e2b-85a4-cd7923a70a67 tempest-VolumesTransfersTest-1829217127 None] Created volume successfully.
Jul 07 22:47:13 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a 1073741824" returned: 0 in 1.092s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:13 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a
Jul 07 22:47:13 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7367fa19-75ea-454f-b10f-a4d1c905a0db tempest-VolumesTransfersTest-326052350 None] Transfer volume completed successfully.
Jul 07 22:47:14 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" returned: 0 in 1.046s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91e4131-d641-4700-b54b-445e45e1cd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43116c1-4fbf-464e-8e7c-f00b001a56cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Volume volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a (ab6298cb-afea-4bda-ab48-2781ccdc3e5a): created successfully
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43116c1-4fbf-464e-8e7c-f00b001a56cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (c51561c4-cc40-42b0-b334-8555d84a84c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fbd0b4e6-1aea-4bed-be34-f4cb66bc65fe tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "cinder-72c85d5e-a487-44d5-9fc4-6490efd8ad72-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-72c85d5e-a487-44d5-9fc4-6490efd8ad72-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "cinder-quobyte-72c85d5e-a487-44d5-9fc4-6490efd8ad72" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-quobyte-72c85d5e-a487-44d5-9fc4-6490efd8ad72" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a884c5b8-5250-433a-95ab-e3361f221570]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-ab6298cb-afea-4bda-ab48-2781ccdc3e5a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "cinder-ab6298cb-afea-4bda-ab48-2781ccdc3e5a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-quobyte-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:15 devstack sudo[100526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72
Jul 07 22:47:15 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c60a6ae-df45-4587-ac96-df25a53e6fec]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:16 devstack sudo[100532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a
Jul 07 22:47:16 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:16 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72" returned: 0 in 1.118s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:16 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72
Jul 07 22:47:16 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:17 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" returned: 0 in 1.265s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:17 devstack sudo[100869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a
Jul 07 22:47:17 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:17 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-72c85d5e-a487-44d5-9fc4-6490efd8ad72" returned: 0 in 1.156s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-quobyte-72c85d5e-a487-44d5-9fc4-6490efd8ad72" released by "delete_volume" :: held 2.353s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=75,cinder:INSERT=15,cinder:UPDATE=77,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Created reservations ['86129ac0-23a6-4249-a999-3354b921802b', '4cea730a-127d-42b6-ba14-70f40b09b564', 'e8d59d3c-8e92-4719-9700-eeb6e451a416', '51d6b0dc-1e7c-450e-9373-7b20428dfb46'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:18 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" returned: 0 in 1.029s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-ab6298cb-afea-4bda-ab48-2781ccdc3e5a" released by "delete_volume" :: held 2.417s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:18 devstack sudo[100876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:18 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Created reservations ['0f85ec6c-22b8-4fc4-a523-070c4bfa30f2', 'c1eb0ab6-8c88-435d-a54d-77e3d60f2582', '3df5dccf-b2a4-4685-b28b-74cb03ee21c6', '0642b5ca-3766-4c38-b1cb-47766bd2710b'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:18 devstack sudo[100879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:18 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:19 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.589s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:19 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Deleted volume successfully.
Jul 07 22:47:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f4f549aa-cfd0-48b3-8476-a92e56458c73 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-72c85d5e-a487-44d5-9fc4-6490efd8ad72-delete_volume" released by "delete_volume" :: held 4.327s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:20 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.533s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Deleted volume successfully.
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d7a71b17-1786-4dbe-944b-5ac4da3fe67b tempest-VolumesActionsTest-210127709 None] Lock "cinder-ab6298cb-afea-4bda-ab48-2781ccdc3e5a-delete_volume" released by "delete_volume" :: held 4.333s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (ba3e68dc-9b81-44c9-ac3b-3a8f11957371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d917ef3a-9fd8-45b6-b763-af370b7ce9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d917ef3a-9fd8-45b6-b763-af370b7ce9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89996501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b003c9f-74a0-4373-960b-cb8f644b9a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:20Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384df6b-95df-457a-8ef6-a4df2c5ab8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7384df6b-95df-457a-8ef6-a4df2c5ab8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3240f012-ca0d-4205-9dcc-5b117d9ede82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3240f012-ca0d-4205-9dcc-5b117d9ede82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b003c9f-74a0-4373-960b-cb8f644b9a63', 'volume_name': 'volume-4b003c9f-74a0-4373-960b-cb8f644b9a63', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46a4f65-2c4a-4d4a-9746-76752cc37a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f46a4f65-2c4a-4d4a-9746-76752cc37a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c236f87c-6dc2-4182-9d81-4f7965cca15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Volume 4b003c9f-74a0-4373-960b-cb8f644b9a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b003c9f-74a0-4373-960b-cb8f644b9a63', 'volume_size': 1}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-89996501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b003c9f-74a0-4373-960b-cb8f644b9a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:20Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Creating volume 4b003c9f-74a0-4373-960b-cb8f644b9a63 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:20 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:20 devstack sudo[100883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 1073741824
Jul 07 22:47:20 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Flow 'volume_create_manager' (0315f717-a972-4fcb-9402-a0b88b01d148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d57399e-d742-4720-bb1e-e947dac3308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d57399e-d742-4720-bb1e-e947dac3308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1366819673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f60b8eadbb4269be00e0faef972cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:20Z,use_quota=True,user_id='39d09a66887d471c90bbe3dd70c37059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37383a35-7331-4da3-8ed8-53ed5ece3486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37383a35-7331-4da3-8ed8-53ed5ece3486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efc553b-76e0-4e2e-9f82-a87180ff4b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3efc553b-76e0-4e2e-9f82-a87180ff4b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969', 'volume_name': 'volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd2d92-1048-4ca5-b269-c951444a270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cdd2d92-1048-4ca5-b269-c951444a270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3723c1f-fad3-43e9-840c-a69bc3fc6ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Volume ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969', 'volume_size': 1}
Jul 07 22:47:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:21 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 1073741824" returned: 0 in 1.115s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:21 devstack sudo[100889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63
Jul 07 22:47:21 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:22 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63" returned: 0 in 0.723s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.753s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1366819673',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f60b8eadbb4269be00e0faef972cb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:20Z,use_quota=True,user_id='39d09a66887d471c90bbe3dd70c37059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Creating volume ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:22 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c236f87c-6dc2-4182-9d81-4f7965cca15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b003c9f-74a0-4373-960b-cb8f644b9a63', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:22 devstack sudo[100892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 1073741824
Jul 07 22:47:22 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7895e9a0-c125-4bba-952d-6c76ccc2f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Volume volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 (4b003c9f-74a0-4373-960b-cb8f644b9a63): created successfully
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7895e9a0-c125-4bba-952d-6c76ccc2f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (ba3e68dc-9b81-44c9-ac3b-3a8f11957371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bb27beb4-caf6-4f6f-b5fe-d3911e50c61d tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-4b003c9f-74a0-4373-960b-cb8f644b9a63-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "cinder-4b003c9f-74a0-4373-960b-cb8f644b9a63-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:23 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 1073741824" returned: 0 in 1.257s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-quobyte-4b003c9f-74a0-4373-960b-cb8f644b9a63" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-4b003c9f-74a0-4373-960b-cb8f644b9a63" acquired by "delete_volume" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e28c64-19e5-45db-b972-391c3d7e9c8f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:23 devstack sudo[100899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969
Jul 07 22:47:23 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (08017b7c-1a20-4acb-98fd-6c2715ee7204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f01d87-a2ac-4439-944e-e8c2e82d869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f01d87-a2ac-4439-944e-e8c2e82d869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118746707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d6546-cdc8-4a5b-b931-aa94e4c981bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:24Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37472787-99d1-4dca-a59b-b9f985b65e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37472787-99d1-4dca-a59b-b9f985b65e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15ca39e-4030-487f-9f8a-252ffe26a4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack sudo[100898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63
Jul 07 22:47:24 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15ca39e-4030-487f-9f8a-252ffe26a4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e9d6546-cdc8-4a5b-b931-aa94e4c981bb', 'volume_name': 'volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da481502-bb5c-4d15-8b6a-1a6cc75b7265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da481502-bb5c-4d15-8b6a-1a6cc75b7265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920dbac2-7908-4324-be54-aa0da8260fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume 4e9d6546-cdc8-4a5b-b931-aa94e4c981bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb', 'volume_size': 1}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:24 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.564s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118746707',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e9d6546-cdc8-4a5b-b931-aa94e4c981bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:24Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume 4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:24 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3723c1f-fad3-43e9-840c-a69bc3fc6ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack sudo[100903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb 1073741824
Jul 07 22:47:24 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813e35b-8d05-40e4-9b0a-808c89d51401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:24 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Volume volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 (ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969): created successfully
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e813e35b-8d05-40e4-9b0a-808c89d51401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Flow 'volume_create_manager' (0315f717-a972-4fcb-9402-a0b88b01d148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:24 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-48981f2f-9089-4cdd-9001-b1cf3a519040 tempest-VolumesTransfersTest-1829217127 None] Created volume successfully.
Jul 07 22:47:24 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63" returned: 0 in 0.932s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:24 devstack sudo[100908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63
Jul 07 22:47:24 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:25 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb 1073741824" returned: 0 in 0.885s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:25 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4b003c9f-74a0-4373-960b-cb8f644b9a63" returned: 0 in 0.711s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-4b003c9f-74a0-4373-960b-cb8f644b9a63" released by "delete_volume" :: held 1.700s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:25 devstack sudo[100914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb
Jul 07 22:47:25 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Created reservations ['de03390c-b47a-464e-a4e2-a3228f2c2303', '0b876d55-780d-4364-a127-22cf07e90b1e', 'fdeb5240-633c-4201-91d7-f3f17d348a27', '6801289c-6963-4f38-b5f6-d5389bbf8eba'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:25 devstack sudo[100917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:25 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "cinder-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "cinder-quobyte-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-quobyte-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd80bf-7450-4ea3-b0ab-2748d929a700]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:26 devstack sudo[100919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969
Jul 07 22:47:26 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:26 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" returned: 0 in 1.161s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (920dbac2-7908-4324-be54-aa0da8260fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf67983-f349-44a2-9c4f-b3defb28245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb (4e9d6546-cdc8-4a5b-b931-aa94e4c981bb): created successfully
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf67983-f349-44a2-9c4f-b3defb28245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (08017b7c-1a20-4acb-98fd-6c2715ee7204) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6860105c-7736-4c1f-a204-3b351834b655 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:26 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.141s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:26 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Deleted volume successfully.
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-80536f07-d554-4a58-8c1c-bbe48587b705 tempest-VolumesActionsTest-210127709 None] Lock "cinder-4b003c9f-74a0-4373-960b-cb8f644b9a63-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (3ba703cf-4bcb-4b5b-bf03-2bf269c73b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7255ce3-b507-480c-a663-ad18d1aa3bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7255ce3-b507-480c-a663-ad18d1aa3bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-803492584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4012792b-2577-4f6f-82c5-88b693753abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:27Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89f9ffe-a29c-41d3-ab89-03a2b71e15d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89f9ffe-a29c-41d3-ab89-03a2b71e15d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a63452-5e04-4ad6-8c73-0ad1a64d449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a63452-5e04-4ad6-8c73-0ad1a64d449a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4012792b-2577-4f6f-82c5-88b693753abc', 'volume_name': 'volume-4012792b-2577-4f6f-82c5-88b693753abc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c644a0fb-5ca2-482e-b6f1-18a1ac7a8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c644a0fb-5ca2-482e-b6f1-18a1ac7a8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537b4a4-acfe-40e5-855b-e8832ca3e1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Volume 4012792b-2577-4f6f-82c5-88b693753abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4012792b-2577-4f6f-82c5-88b693753abc', 'volume_size': 1}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-803492584',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4012792b-2577-4f6f-82c5-88b693753abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:27Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Creating volume 4012792b-2577-4f6f-82c5-88b693753abc {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:27 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:27 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc 1073741824
Jul 07 22:47:27 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:27 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" returned: 0 in 1.301s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:27 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969
Jul 07 22:47:27 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:28 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc 1073741824" returned: 0 in 0.900s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:28 devstack sudo[100935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc
Jul 07 22:47:28 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:28 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" returned: 0 in 0.716s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-quobyte-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969" released by "delete_volume" :: held 2.087s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Created reservations ['47d5d599-b6d7-4300-806c-c35b0c461a61', 'eba16d96-16a1-400f-b68a-4fb8e217fa07', '97147352-5f98-40a6-86ce-93ce6ce39eb0', '016d322b-fcaf-4f95-a521-e5428502984e'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:28 devstack sudo[100938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:28 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:28 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc" returned: 0 in 0.704s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.513s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537b4a4-acfe-40e5-855b-e8832ca3e1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4012792b-2577-4f6f-82c5-88b693753abc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98165e6-8e3e-4117-b02a-5f7bd272ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating offline snapshot daf578ea-898e-4088-aa47-d767df979e9a of volume 4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:47:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Volume volume-4012792b-2577-4f6f-82c5-88b693753abc (4012792b-2577-4f6f-82c5-88b693753abc): created successfully
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d98165e6-8e3e-4117-b02a-5f7bd272ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (3ba703cf-4bcb-4b5b-bf03-2bf269c73b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[737f3790-af0c-4d15-8fdf-ff40595e102b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-050337c8-88b5-4826-9416-8a8c8c6d65d8 tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:47:29 devstack sudo[100941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb
Jul 07 22:47:29 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:29 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.678s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Deleted volume successfully.
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd8c2b0c-4779-48db-9b60-e323b3ef37e6 tempest-VolumesTransfersTest-1010473633 None] Lock "cinder-ea6db5d9-3d7e-4d2f-b3e8-4a3ed1ab3969-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-4012792b-2577-4f6f-82c5-88b693753abc-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "cinder-4012792b-2577-4f6f-82c5-88b693753abc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-quobyte-4012792b-2577-4f6f-82c5-88b693753abc" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-4012792b-2577-4f6f-82c5-88b693753abc" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6799a877-212c-49ad-9b72-b6d44943c0a0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:29 devstack sudo[100944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc
Jul 07 22:47:29 devstack sudo[100944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:30 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" returned: 0 in 1.111s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:30 devstack sudo[100949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a 1G
Jul 07 22:47:30 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:30 devstack sudo[100944]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc" returned: 0 in 0.911s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:30 devstack sudo[100954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc
Jul 07 22:47:30 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:31 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a 1G" returned: 0 in 1.081s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:31 devstack sudo[100961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a
Jul 07 22:47:31 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:31 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4012792b-2577-4f6f-82c5-88b693753abc" returned: 0 in 0.882s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-4012792b-2577-4f6f-82c5-88b693753abc" released by "delete_volume" :: held 1.842s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Created reservations ['3ce88194-d05d-4be6-8478-3d94d2ab2954', 'bbfb1f12-81cb-40af-a4ab-f5b36203ed3a', '10b5f052-ec76-4351-beef-719bc5b83370', '7a02c545-e19a-4eea-baad-42cf3706a717'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:31 devstack sudo[100964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:31 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (13c8bca5-f226-4180-a431-0df908e04ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1871f5-0165-4be2-8a28-9cbede59094c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e1871f5-0165-4be2-8a28-9cbede59094c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948556440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7c0e1-699f-4d82-8173-9ffd6b115079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:32Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f713c255-6e87-4b9c-bd2b-429ca7fd1f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f713c255-6e87-4b9c-bd2b-429ca7fd1f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774c6ad7-6dac-40ef-8e0f-b44981380a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774c6ad7-6dac-40ef-8e0f-b44981380a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f7c0e1-699f-4d82-8173-9ffd6b115079', 'volume_name': 'volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d8221d-0a15-41d9-b68c-4d98c6aaa838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d8221d-0a15-41d9-b68c-4d98c6aaa838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92becf5-0e1d-4a69-9124-785034ad8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Volume f5f7c0e1-699f-4d82-8173-9ffd6b115079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079', 'volume_size': 1}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:32 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a" returned: 0 in 1.597s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:32 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a is being set with open permissions: ugo+rw
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:32 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.228s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Deleted volume successfully.
Jul 07 22:47:32 devstack sudo[100971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a
Jul 07 22:47:32 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-b35c5ed4-5c5e-48f0-a0a4-6d3142926aed tempest-VolumesActionsTest-210127709 None] Lock "cinder-4012792b-2577-4f6f-82c5-88b693753abc-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:33 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a" returned: 0 in 0.745s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:33 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info
Jul 07 22:47:33 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:33 devstack sudo[101009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:33 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:34 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:34 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info is being set with open permissions: ugo+rw
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:34 devstack sudo[101012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info
Jul 07 22:47:34 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:34 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.731s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:47:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:47:35 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.info" returned: 0 in 0.789s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.273s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.504s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1948556440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f7c0e1-699f-4d82-8173-9ffd6b115079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:32Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Creating volume f5f7c0e1-699f-4d82-8173-9ffd6b115079 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:35 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:35 devstack sudo[101016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 1073741824
Jul 07 22:47:35 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b47e9060-08cd-4fb9-a194-fdb1e04ca234 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Create snapshot completed successfully
Jul 07 22:47:36 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 1073741824" returned: 0 in 1.005s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:36 devstack sudo[101023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079
Jul 07 22:47:36 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (69670091-aead-49e9-9649-d58b31658c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc34a644-d749-49a6-8d1e-f9ce6e958a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc34a644-d749-49a6-8d1e-f9ce6e958a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355564829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5aab1e-9543-4cab-a162-e569284e9df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fea496-b8e3-4f5c-b069-51e72cd57b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fea496-b8e3-4f5c-b069-51e72cd57b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c96a1c-7c66-4d83-9ba9-435ec021c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11c96a1c-7c66-4d83-9ba9-435ec021c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5aab1e-9543-4cab-a162-e569284e9df1', 'volume_name': 'volume-da5aab1e-9543-4cab-a162-e569284e9df1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4e8533-b04a-43d5-b157-3f56e107fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4e8533-b04a-43d5-b157-3f56e107fb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4154d7ce-2b71-40d8-8d01-ec5defe96538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:36 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume da5aab1e-9543-4cab-a162-e569284e9df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5aab1e-9543-4cab-a162-e569284e9df1', 'volume_size': 1}
Jul 07 22:47:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:37 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079" returned: 0 in 1.012s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.154s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1355564829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5aab1e-9543-4cab-a162-e569284e9df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume da5aab1e-9543-4cab-a162-e569284e9df1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92becf5-0e1d-4a69-9124-785034ad8573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack sudo[101026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 1073741824
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bb31b2-cfbe-4ff5-b4f4-d2b4a74dd76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (4c5a1698-530d-47be-adc5-cbc821a15f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20b82d-9e87-4406-91a2-2736d473b920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Volume volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 (f5f7c0e1-699f-4d82-8173-9ffd6b115079): created successfully
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bb31b2-cfbe-4ff5-b4f4-d2b4a74dd76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (13c8bca5-f226-4180-a431-0df908e04ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b20b82d-9e87-4406-91a2-2736d473b920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704808299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3324ffa-463e-4886-be66-704972850f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a6befc-b994-40fb-811b-ef15edc98d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a6befc-b994-40fb-811b-ef15edc98d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3198786a-88b8-464e-bb99-46a2982f8a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3198786a-88b8-464e-bb99-46a2982f8a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3324ffa-463e-4886-be66-704972850f4b', 'volume_name': 'volume-b3324ffa-463e-4886-be66-704972850f4b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bc3f2-8430-49f3-965a-0d7fa89a0267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bc3f2-8430-49f3-965a-0d7fa89a0267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de21d7-588e-4cba-83d4-7ca6fa41ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume b3324ffa-463e-4886-be66-704972850f4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3324ffa-463e-4886-be66-704972850f4b', 'volume_size': 1}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6f55149e-c943-41b3-b1cd-faf2c754ed17 tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Flow 'volume_create_manager' (74a3e115-a17a-49e6-a575-02bc1a3d8783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e174bf-8e23-493c-84de-f6ca94704c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e174bf-8e23-493c-84de-f6ca94704c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1199229917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d04a95-434a-463a-9886-4c49bd27e590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4fa659416a4be9806d1055f13e471e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='dbe0bcb709aa4712a596ce4fb89f241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f504d7a-349c-48a4-b626-8f960c43f0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f504d7a-349c-48a4-b626-8f960c43f0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca106a-dd56-4af7-8529-ab7ab290e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daca106a-dd56-4af7-8529-ab7ab290e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96d04a95-434a-463a-9886-4c49bd27e590', 'volume_name': 'volume-96d04a95-434a-463a-9886-4c49bd27e590', 'volume_size': 2}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa94704-4d85-43eb-8d7d-a600492c3139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aa94704-4d85-43eb-8d7d-a600492c3139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf95c4f5-1445-47e2-92fc-d27b4258b104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Volume 96d04a95-434a-463a-9886-4c49bd27e590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96d04a95-434a-463a-9886-4c49bd27e590', 'volume_size': 2}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (54a12790-841f-40d0-b700-ae9b34c883bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffdbb43-6496-46e9-8a2d-9c23fe9560d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffdbb43-6496-46e9-8a2d-9c23fe9560d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022075756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9d0908-d614-46ca-b89c-dc37a7066c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:38Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1327e-7205-47e1-badd-3b6344226756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c1327e-7205-47e1-badd-3b6344226756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd85bef-3ed7-4622-9b00-04ade7b4bf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd85bef-3ed7-4622-9b00-04ade7b4bf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9d0908-d614-46ca-b89c-dc37a7066c8c', 'volume_name': 'volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f837273b-3918-4e0c-8cde-8741250912dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f837273b-3918-4e0c-8cde-8741250912dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238ba7da-4d4b-4377-86b3-307b7c834545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume ef9d0908-d614-46ca-b89c-dc37a7066c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c', 'volume_size': 1}
Jul 07 22:47:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (720e5814-9083-4190-9c1f-74b9474c94f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a711335-248a-423d-b4f5-d1565dc0c671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a711335-248a-423d-b4f5-d1565dc0c671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663719428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e80379-70c6-4462-9a74-a6c65e96ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:38Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68134668-a7a9-4bd1-b678-b7c46a7bccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68134668-a7a9-4bd1-b678-b7c46a7bccfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1413af0d-339c-417c-8b57-ece175f8073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1413af0d-339c-417c-8b57-ece175f8073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8e80379-70c6-4462-9a74-a6c65e96ce3b', 'volume_name': 'volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4b0c1a-cb04-4f41-8747-b5ab56a9cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4b0c1a-cb04-4f41-8747-b5ab56a9cfca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f1c16-e517-48ba-92e9-ae704df8a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume c8e80379-70c6-4462-9a74-a6c65e96ce3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b', 'volume_size': 1}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-f5f7c0e1-699f-4d82-8173-9ffd6b115079-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "cinder-f5f7c0e1-699f-4d82-8173-9ffd6b115079-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Acquiring lock "cinder-quobyte-f5f7c0e1-699f-4d82-8173-9ffd6b115079" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:38 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 1073741824" returned: 0 in 1.254s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-f5f7c0e1-699f-4d82-8173-9ffd6b115079" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5de0ad-f01a-432a-9a49-a7cfaa14cb2f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (210a9552-0b29-4106-9232-9f94caa78dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2959f0d5-0cd1-4ea3-bdee-72fcf784cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2959f0d5-0cd1-4ea3-bdee-72fcf784cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299686206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bfc893-1670-4b2b-b4da-97819b30e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:39Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89735057-f9c4-434f-b78e-62a3118136b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89735057-f9c4-434f-b78e-62a3118136b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae881c73-199f-4004-b2c5-c4b2d6866dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae881c73-199f-4004-b2c5-c4b2d6866dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0bfc893-1670-4b2b-b4da-97819b30e7d7', 'volume_name': 'volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc56b6f-dc41-44b6-8a8b-efcbb827a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc56b6f-dc41-44b6-8a8b-efcbb827a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817cfa69-2d2b-4183-a4af-49d20a751c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume e0bfc893-1670-4b2b-b4da-97819b30e7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7', 'volume_size': 1}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:38 devstack sudo[101038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079
Jul 07 22:47:38 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:38 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1
Jul 07 22:47:38 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:39 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1" returned: 0 in 0.676s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.793s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1704808299',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3324ffa-463e-4886-be66-704972850f4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume b3324ffa-463e-4886-be66-704972850f4b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4154d7ce-2b71-40d8-8d01-ec5defe96538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5aab1e-9543-4cab-a162-e569284e9df1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bad5cb-d791-4912-bc56-ffbab52da8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:39 devstack sudo[101046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b 1073741824
Jul 07 22:47:39 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-da5aab1e-9543-4cab-a162-e569284e9df1 (da5aab1e-9543-4cab-a162-e569284e9df1): created successfully
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bad5cb-d791-4912-bc56-ffbab52da8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (69670091-aead-49e9-9649-d58b31658c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:39 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079" returned: 0 in 0.882s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-051af64b-be41-4490-bf54-0c3bb086112b tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:39 devstack sudo[101048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079
Jul 07 22:47:39 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:40 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f5f7c0e1-699f-4d82-8173-9ffd6b115079" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "cinder-quobyte-f5f7c0e1-699f-4d82-8173-9ffd6b115079" released by "delete_volume" :: held 1.740s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Created reservations ['a87d329e-7309-42aa-bac8-b1e35a4b61fa', '44a9ba99-7e77-4bdd-bf43-801bd1cd8c1d', '29aa83c4-240a-4254-a99b-aeecd51a23b6', '18dbacd6-3271-465a-9444-cef7632c90b2'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:40 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:40 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:40 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b 1073741824" returned: 0 in 1.147s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:40 devstack sudo[101057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b
Jul 07 22:47:40 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:41 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.805s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Deleted volume successfully.
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-53d4252c-3ce1-48e6-960f-7ddd264df4b4 tempest-VolumesActionsTest-210127709 None] Lock "cinder-f5f7c0e1-699f-4d82-8173-9ffd6b115079-delete_volume" released by "delete_volume" :: held 2.881s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:41 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b" returned: 0 in 0.933s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.799s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1199229917',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d04a95-434a-463a-9886-4c49bd27e590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c4fa659416a4be9806d1055f13e471e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:37Z,use_quota=True,user_id='dbe0bcb709aa4712a596ce4fb89f241f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Creating volume 96d04a95-434a-463a-9886-4c49bd27e590 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:41 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 2147483648 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:41 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 2147483648
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47de21d7-588e-4cba-83d4-7ca6fa41ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3324ffa-463e-4886-be66-704972850f4b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccb0d83-cab1-444e-a33a-995e80139d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-b3324ffa-463e-4886-be66-704972850f4b (b3324ffa-463e-4886-be66-704972850f4b): created successfully
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccb0d83-cab1-444e-a33a-995e80139d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (4c5a1698-530d-47be-adc5-cbc821a15f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c77b1d7b-b894-4032-9976-34407354e742 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (7668e4aa-39b2-4d46-9368-0d6450a39115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5f07f-66b4-4cc8-9a74-babc04973359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc5f07f-66b4-4cc8-9a74-babc04973359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058737468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cfe64f-2b9b-4845-8b1c-8e7f7987931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:42Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a91ba9f-ebe5-4f37-b1cc-ab0846b89b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a91ba9f-ebe5-4f37-b1cc-ab0846b89b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e74bc4-0db0-46bf-abc2-91f63bb49728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e74bc4-0db0-46bf-abc2-91f63bb49728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cfe64f-2b9b-4845-8b1c-8e7f7987931d', 'volume_name': 'volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768bfda0-07e7-448c-89a1-53f18e350acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768bfda0-07e7-448c-89a1-53f18e350acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff44782-9b70-403f-81fa-49477590e4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Volume d0cfe64f-2b9b-4845-8b1c-8e7f7987931d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d', 'volume_size': 1}
Jul 07 22:47:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:42 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 2147483648" returned: 0 in 1.040s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:42 devstack sudo[101067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590
Jul 07 22:47:42 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:43 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590" returned: 0 in 0.694s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.482s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022075756',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9d0908-d614-46ca-b89c-dc37a7066c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:38Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume ef9d0908-d614-46ca-b89c-dc37a7066c8c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:43 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf95c4f5-1445-47e2-92fc-d27b4258b104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d04a95-434a-463a-9886-4c49bd27e590', 'volume_size': 2}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:43 devstack sudo[101070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c 1073741824
Jul 07 22:47:43 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c38cc07-2d3f-4b6b-bbd6-e71b84a97cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:43 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Volume volume-96d04a95-434a-463a-9886-4c49bd27e590 (96d04a95-434a-463a-9886-4c49bd27e590): created successfully
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c38cc07-2d3f-4b6b-bbd6-e71b84a97cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Flow 'volume_create_manager' (74a3e115-a17a-49e6-a575-02bc1a3d8783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5fe03a6f-2568-4e95-a577-cdc879432cac tempest-VolumesCloneNegativeTest-1089061049 None] Created volume successfully.
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Acquiring lock "cinder-96d04a95-434a-463a-9886-4c49bd27e590-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "cinder-96d04a95-434a-463a-9886-4c49bd27e590-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Acquiring lock "cinder-quobyte-96d04a95-434a-463a-9886-4c49bd27e590" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "cinder-quobyte-96d04a95-434a-463a-9886-4c49bd27e590" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[503faa13-203d-4480-866b-ba02edea3d8d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:44 devstack sudo[101075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590
Jul 07 22:47:44 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:44 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c 1073741824" returned: 0 in 0.901s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:44 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c
Jul 07 22:47:44 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:44 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590" returned: 0 in 0.860s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:44 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590
Jul 07 22:47:45 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:45 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.740s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-663719428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8e80379-70c6-4462-9a74-a6c65e96ce3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:38Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume c8e80379-70c6-4462-9a74-a6c65e96ce3b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:45 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238ba7da-4d4b-4377-86b3-307b7c834545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:45 devstack sudo[101086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b 1073741824
Jul 07 22:47:45 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02226d09-aaed-4f73-8d94-59bd60be2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:45 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c (ef9d0908-d614-46ca-b89c-dc37a7066c8c): created successfully
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02226d09-aaed-4f73-8d94-59bd60be2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (54a12790-841f-40d0-b700-ae9b34c883bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-08a64eac-76d7-4ad2-acb2-891f0cad4d6c tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:45 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-96d04a95-434a-463a-9886-4c49bd27e590" returned: 0 in 0.665s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "cinder-quobyte-96d04a95-434a-463a-9886-4c49bd27e590" released by "delete_volume" :: held 1.565s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Created reservations ['b9f290de-0f84-42c9-a007-ea1d46866182', '2675f60b-6672-46bb-987e-2e3e39981cd5', '38db5d8b-668c-4208-b58d-b024f32a4124', '132f1742-ce86-4ea2-b3df-5e9985bf639c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:45 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:45 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:45 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b 1073741824" returned: 0 in 0.923s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:46 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b
Jul 07 22:47:46 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:46 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.668s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Deleted volume successfully.
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7285ad-1c4f-4a04-b54d-3d04a88e1282 tempest-VolumesCloneNegativeTest-1089061049 None] Lock "cinder-96d04a95-434a-463a-9886-4c49bd27e590-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:46 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b" returned: 0 in 0.788s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.025s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299686206',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0bfc893-1670-4b2b-b4da-97819b30e7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41bb3e28b85b495f90aac920ee1cc391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:39Z,use_quota=True,user_id='1782fc7d140f421f9d07307df8fa8022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Creating volume e0bfc893-1670-4b2b-b4da-97819b30e7d7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:46 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:46 devstack sudo[101100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 1073741824
Jul 07 22:47:46 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (804f1c16-e517-48ba-92e9-ae704df8a784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3572df0-738c-44b6-824f-177881540ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:46 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b (c8e80379-70c6-4462-9a74-a6c65e96ce3b): created successfully
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3572df0-738c-44b6-824f-177881540ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (720e5814-9083-4190-9c1f-74b9474c94f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c5f9c521-d8d2-4e76-a4a1-1b2acedfae92 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:47 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 1073741824" returned: 0 in 0.976s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:47 devstack sudo[101106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7
Jul 07 22:47:47 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:48 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7" returned: 0 in 0.838s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.834s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2058737468',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cfe64f-2b9b-4845-8b1c-8e7f7987931d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fa20cb2ab2469ba2c759b853c486a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:42Z,use_quota=True,user_id='a97a276116404b828db3d9f5201e11f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Creating volume d0cfe64f-2b9b-4845-8b1c-8e7f7987931d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:48 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817cfa69-2d2b-4183-a4af-49d20a751c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:48 devstack sudo[101109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d 1073741824
Jul 07 22:47:48 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d65e70-dc0d-4029-b849-88ac6acede31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Volume volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 (e0bfc893-1670-4b2b-b4da-97819b30e7d7): created successfully
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80d65e70-dc0d-4029-b849-88ac6acede31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Flow 'volume_create_manager' (210a9552-0b29-4106-9232-9f94caa78dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-084c7595-b492-48b2-b7b4-5cbf020a6ef1 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created volume successfully.
Jul 07 22:47:49 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d 1073741824" returned: 0 in 0.893s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:49 devstack sudo[101115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d
Jul 07 22:47:49 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-e0bfc893-1670-4b2b-b4da-97819b30e7d7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-e0bfc893-1670-4b2b-b4da-97819b30e7d7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-e0bfc893-1670-4b2b-b4da-97819b30e7d7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-e0bfc893-1670-4b2b-b4da-97819b30e7d7" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cabf887-b062-4a7d-82f2-0f41c0b4caeb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:49 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7
Jul 07 22:47:49 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Flow 'volume_create_manager' (65b1133e-7b53-4118-be5a-30a23ecc2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae17d1c3-5ca4-4a15-bb68-578ab5ca6183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae17d1c3-5ca4-4a15-bb68-578ab5ca6183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-316661850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b484fb24-5e00-4344-8d81-fdc7fef8e8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575bc3350ae432e9c0d5ea04c64a69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:50Z,use_quota=True,user_id='e396183402fc486f9257db5700140ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b69abff-eae5-4ada-b5a0-9e6c6e1b8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b69abff-eae5-4ada-b5a0-9e6c6e1b8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68097871-1fbb-467f-82e8-2302a97592f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68097871-1fbb-467f-82e8-2302a97592f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b484fb24-5e00-4344-8d81-fdc7fef8e8a2', 'volume_name': 'volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe745de480>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9923bb0-7b07-465f-a318-9563100f9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9923bb0-7b07-465f-a318-9563100f9973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2391c478-cc86-4eb8-99cb-685c085b2f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe745de480>}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Trying to clone b484fb24-5e00-4344-8d81-fdc7fef8e8a2 from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:47:50 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ff44782-9b70-403f-81fa-49477590e4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa9120-6dc4-40bd-a6fc-8eaf33ca77af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:47:50 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Volume volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d (d0cfe64f-2b9b-4845-8b1c-8e7f7987931d): created successfully
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7faa9120-6dc4-40bd-a6fc-8eaf33ca77af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Flow 'volume_create_manager' (7668e4aa-39b2-4d46-9368-0d6450a39115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:47:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e618e2df-bb31-4f21-a7e6-4fdc0dac3a26 tempest-VolumesActionsTest-246993091 None] Created volume successfully.
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:47:50 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:47:50 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7" returned: 0 in 0.833s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c803724-e71b-44bf-8c71-c2de775028ae]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:50 devstack sudo[101124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7
Jul 07 22:47:50 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:50 devstack sudo[101125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD
Jul 07 22:47:50 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:51 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0bfc893-1670-4b2b-b4da-97819b30e7d7" returned: 0 in 0.652s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-e0bfc893-1670-4b2b-b4da-97819b30e7d7" released by "delete_volume" :: held 1.535s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['c0ace1ae-dc51-4e16-aa1b-b7eb6f913195', '64eba479-286d-4b81-be1c-32a27fe0a1be', 'f11dff7e-a4a2-419a-b4d8-5ac70ef0116b', '42a74c15-df00-415b-af7d-dacd6d876bc6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:51 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a is fetched for user e396183402fc486f9257db5700140ea0. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:47:51 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:51 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f3b77b-6d7b-4c8f-8e61-532b66a8b201]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:51 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD
Jul 07 22:47:51 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "cinder-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Acquiring lock "cinder-quobyte-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "cinder-quobyte-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[678dc787-4784-4d2f-9bf5-10aa08c0c2f6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-c8e80379-70c6-4462-9a74-a6c65e96ce3b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-c8e80379-70c6-4462-9a74-a6c65e96ce3b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-c8e80379-70c6-4462-9a74-a6c65e96ce3b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:52 devstack sudo[101136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d
Jul 07 22:47:52 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-c8e80379-70c6-4462-9a74-a6c65e96ce3b" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc22bbc-3aed-4d21-8b69-93e909ee6caf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:52 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:52 devstack sudo[101139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b
Jul 07 22:47:52 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5e2b5da5-da3c-4251-a8a2-eb26039eacc7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-e0bfc893-1670-4b2b-b4da-97819b30e7d7-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:52 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD" returned: 0 in 0.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-316661850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b484fb24-5e00-4344-8d81-fdc7fef8e8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575bc3350ae432e9c0d5ea04c64a69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:47:50Z,use_quota=True,user_id='e396183402fc486f9257db5700140ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Creating volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:47:52 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:52 devstack sudo[101144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1073741824
Jul 07 22:47:52 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:52 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" returned: 0 in 0.896s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:52 devstack sudo[101152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d
Jul 07 22:47:52 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:53 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b" returned: 0 in 0.832s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:53 devstack sudo[101154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b
Jul 07 22:47:53 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:53 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1073741824" returned: 0 in 0.925s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:53 devstack sudo[101160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:47:53 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:53 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "cinder-quobyte-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d" released by "delete_volume" :: held 1.710s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:53 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c8e80379-70c6-4462-9a74-a6c65e96ce3b" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-c8e80379-70c6-4462-9a74-a6c65e96ce3b" released by "delete_volume" :: held 1.561s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Created reservations ['398a0613-d8aa-4f6d-a5c8-ceaa0fdbb156', '20efd515-0bb1-4c1d-8c29-1e014262551e', 'ea48d9aa-46a6-4cff-be37-11dd061f63a1', '151b148d-1eb6-4998-a362-bc365d345698'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['ce849aa7-58b5-40dd-a67d-5811b56b1055', '0022b889-7bc1-4e1b-bc80-a5009e95eecd', 'fd1a8a70-f07b-4569-b075-6a70a54c10d8', 'f05b50d8-94f9-4290-adce-4c2732f8b1a6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:53 devstack sudo[101166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:53 devstack sudo[101166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:53 devstack sudo[101168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:53 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:54 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 0.868s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Attempting download of 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15e36ba-75f7-4296-8557-e8494567f4bc]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-ef9d0908-d614-46ca-b89c-dc37a7066c8c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-ef9d0908-d614-46ca-b89c-dc37a7066c8c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:54 devstack sudo[101173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2
Jul 07 22:47:54 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-ef9d0908-d614-46ca-b89c-dc37a7066c8c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-ef9d0908-d614-46ca-b89c-dc37a7066c8c" acquired by "delete_volume" :: waited 0.045s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1b84ce-3012-474b-bf5c-4ddf13b7b3e9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:54 devstack sudo[101175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c
Jul 07 22:47:54 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:55 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.240s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:47:55 devstack sudo[101166]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.340s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Deleted volume successfully.
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dbdfb3f2-977e-4b00-b874-a96a6c1875f7 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-c8e80379-70c6-4462-9a74-a6c65e96ce3b-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cde02453-ca07-41a5-ac00-acbe2e4339db tempest-VolumesActionsTest-246993091 None] Lock "cinder-d0cfe64f-2b9b-4845-8b1c-8e7f7987931d-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:55 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2" returned: 0 in 1.043s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:55 devstack sudo[101182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2
Jul 07 22:47:55 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:56 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c" returned: 0 in 1.343s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:56 devstack sudo[101190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c
Jul 07 22:47:56 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:56 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2" returned: 1 in 1.089s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qxsec0k2' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e585248-c426-44b7-93ff-edb3c2d6ee77]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:56 devstack sudo[101194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD
Jul 07 22:47:56 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:56 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef9d0908-d614-46ca-b89c-dc37a7066c8c" returned: 0 in 0.798s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-ef9d0908-d614-46ca-b89c-dc37a7066c8c" released by "delete_volume" :: held 2.228s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:56 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['eb68fdda-8a47-472f-a207-ba91490f85c8', '719e49cd-9012-490d-9eb9-f4a69f0278af', '517d7cf7-d190-4296-b908-22b6fc38cd0b', '4d516857-4bad-4bde-8507-51954803d9ec'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:57 devstack sudo[101199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:47:57 devstack sudo[101199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:57 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD" returned: 0 in 1.075s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] 3d79ec3d-7feb-4185-b960-5d4caffe8b9a was qcow2, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:47:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:57 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:47:57 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:58 devstack sudo[101199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.018s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-b3324ffa-463e-4886-be66-704972850f4b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-b3324ffa-463e-4886-be66-704972850f4b-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-08a2b595-d619-419d-864e-9b05841a62a2 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-ef9d0908-d614-46ca-b89c-dc37a7066c8c-delete_volume" released by "delete_volume" :: held 3.682s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-b3324ffa-463e-4886-be66-704972850f4b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-b3324ffa-463e-4886-be66-704972850f4b" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f198b9-bf65-409b-9796-6f7e6755083a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:47:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:58 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b
Jul 07 22:47:58 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:47:59 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Jul 07 22:47:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b" returned: 0 in 1.222s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:47:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:47:59 devstack sudo[101243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b
Jul 07 22:47:59 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:00 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b3324ffa-463e-4886-be66-704972850f4b" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-b3324ffa-463e-4886-be66-704972850f4b" released by "delete_volume" :: held 2.093s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['a1d1ab6f-428a-4fca-b8f5-d328c24533e8', '29a63ce9-df7b-40da-80c2-d1323f86eae4', '9085cba3-0ddd-4c84-88bd-b35425f9708b', '043809d9-856f-482f-9feb-7f054e9175c0'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:00 devstack sudo[101286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:00 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-cd82e1f5-488d-4487-82cb-db042fe35c71 tempest-TestShelveInstance-1775621835 None] Terminate volume connection completed successfully.
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-cd82e1f5-488d-4487-82cb-db042fe35c71 tempest-TestShelveInstance-1775621835 None] Deleting attachment feffabec-13a3-447b-a012-4a12c114da7e. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:48:00 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 3.191s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_v2lpk9vwdevstack@QuobyteHD, size 112.00 MB, duration 3.19 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:48:00 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Converted 112.00 MB image at 35.09 MB/s
Jul 07 22:48:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:00 devstack sudo[101288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1G
Jul 07 22:48:00 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Acquiring lock "cinder-60331b1c-f0a8-4914-857b-dc543f068b7a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "cinder-60331b1c-f0a8-4914-857b-dc543f068b7a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Acquiring lock "cinder-quobyte-60331b1c-f0a8-4914-857b-dc543f068b7a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "cinder-quobyte-60331b1c-f0a8-4914-857b-dc543f068b7a" acquired by "delete_volume" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac1f86c-fdde-4a31-bf5e-ba9da34c8fe0]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:01 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-da5aab1e-9543-4cab-a162-e569284e9df1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.029s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-da5aab1e-9543-4cab-a162-e569284e9df1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1314ceb1-372c-40fd-bffa-848f00ae5caf tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-b3324ffa-463e-4886-be66-704972850f4b-delete_volume" released by "delete_volume" :: held 3.556s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:01 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 1G" returned: 0 in 0.949s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-da5aab1e-9543-4cab-a162-e569284e9df1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-da5aab1e-9543-4cab-a162-e569284e9df1" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a66aa18-6793-4230-9e47-8ec7615b1de8]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:01 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:48:01 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e437391-7251-4fa0-85e3-c38934393c3e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:02 devstack sudo[101298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1
Jul 07 22:48:02 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:02 devstack sudo[101296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:02 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:02 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 1.239s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:02 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1" returned: 0 in 1.109s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:03 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1
Jul 07 22:48:03 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:03 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 1.217s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:03 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:48:03 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:03 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:03 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:03 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-da5aab1e-9543-4cab-a162-e569284e9df1" returned: 0 in 0.822s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-da5aab1e-9543-4cab-a162-e569284e9df1" released by "delete_volume" :: held 2.017s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=115,cinder:INSERT=41,cinder:UPDATE=163,cinder:DELETE=14 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:48:03 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['237a4f4e-e879-4026-a778-30b3828af941', 'a8bbb3d0-f7c6-4f42-b869-8be66d772b62', '6e577287-9daf-4ea5-88f9-71a55476471d', '5caa70c4-fb2a-4762-9ad1-9a87115906fa'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:04 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 1 in 1.131s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:04 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a
Jul 07 22:48:04 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:04 devstack sudo[101326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:04 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:04 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 1 in 1.121s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Downloaded image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2 successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a for user e396183402fc486f9257db5700140ea0 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Marking volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2 as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Copying metadata from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a to b484fb24-5e00-4344-8d81-fdc7fef8e8a2. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Creating volume glance metadata for volume b484fb24-5e00-4344-8d81-fdc7fef8e8a2 backed by image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2391c478-cc86-4eb8-99cb-685c085b2f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe745de480>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6443503b-c430-4b0e-bb9c-214ed0c237e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Volume volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 (b484fb24-5e00-4344-8d81-fdc7fef8e8a2): created successfully
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6443503b-c430-4b0e-bb9c-214ed0c237e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Flow 'volume_create_manager' (65b1133e-7b53-4118-be5a-30a23ecc2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4640a613-5c65-4096-9c9e-8b3c6fc767ed tempest-VolumesExtendTest-1736736842 None] Created volume successfully.
Jul 07 22:48:04 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-60331b1c-f0a8-4914-857b-dc543f068b7a" returned: 0 in 0.902s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "cinder-quobyte-60331b1c-f0a8-4914-857b-dc543f068b7a" released by "delete_volume" :: held 3.395s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:04 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.898s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.quota [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Created reservations ['a918c241-ccbd-4789-96f5-fb8b3bec2371', '088e10cb-1dbc-459b-8c35-11e6688da35a', 'b9d8a8c5-7cf0-49ac-b89e-633517ba1afb', 'd15505ab-621c-4f6b-9d5b-419311bf5d40'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3fc6c1b1-58b2-4929-9c0a-dde9a4185ef4 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-da5aab1e-9543-4cab-a162-e569284e9df1-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-daf578ea-898e-4088-aa47-d767df979e9a-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-daf578ea-898e-4088-aa47-d767df979e9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:05 devstack sudo[101330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:05 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-daf578ea-898e-4088-aa47-d767df979e9a" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-daf578ea-898e-4088-aa47-d767df979e9a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleting offline snapshot daf578ea-898e-4088-aa47-d767df979e9a of volume 4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] snapshot_file for this snap is: volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[256e3501-ecfd-4d5d-aa18-883561573afe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:05 devstack sudo[101332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a
Jul 07 22:48:05 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d61941-532c-4990-9275-6a6ef900ce72]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:05 devstack sudo[101334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:05 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:06 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.062s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG cinder.manager [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Deleted volume successfully.
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [req-add29b16-1c9a-4b84-b4bf-a3b9f01e2e8a req-ad07d381-ea37-4399-916e-d0f15cef87fe tempest-TestShelveInstance-1775621835 None] Lock "cinder-60331b1c-f0a8-4914-857b-dc543f068b7a-delete_volume" released by "delete_volume" :: held 4.858s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:06 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a" returned: 0 in 1.074s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb43dc1a-01f9-4aa2-84b5-3f8845fa48bd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:06 devstack sudo[101344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb
Jul 07 22:48:06 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:06 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 1.163s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:06 devstack sudo[101346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:06 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:07 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" returned: 0 in 0.946s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:07 devstack sudo[101351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a
Jul 07 22:48:07 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:07 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 1 in 0.942s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 2G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 2G" returned: 0 in 0.106s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.294s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2a83e6cb-8ebe-4f54-90ad-b8d6b08fc78c tempest-VolumesExtendTest-1736736842 None] Extend volume completed successfully.
Jul 07 22:48:08 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a" returned: 0 in 0.967s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:08 devstack sudo[101363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a
Jul 07 22:48:08 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-b484fb24-5e00-4344-8d81-fdc7fef8e8a2-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-b484fb24-5e00-4344-8d81-fdc7fef8e8a2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:09 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb.daf578ea-898e-4088-aa47-d767df979e9a" returned: 0 in 0.890s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-quobyte-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-daf578ea-898e-4088-aa47-d767df979e9a" released by "_delete_snapshot" :: held 4.088s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" released by "delete_snapshot" :: held 4.118s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b65000-3da4-42c7-a09d-b06b68132529]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['8edab6b2-b24f-4d62-b8e7-bd3f047d1e76', 'a0378c6c-8072-46e3-8327-17c4bd9151a9', '462d26cd-5669-4ad3-b94c-71bf1b2599e7', 'b7e630b1-9e65-4610-b81c-46030808b2bd'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:09 devstack sudo[101367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:09 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Delete snapshot completed successfully.
Jul 07 22:48:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7597e0a6-8305-4ecf-ae74-8101e35248d8 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-daf578ea-898e-4088-aa47-d767df979e9a-delete_snapshot" released by "delete_snapshot" :: held 4.332s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:10 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 0.886s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:10 devstack sudo[101371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:10 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1ce93c-7741-4105-9889-7daec5d33bfa]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:10 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb
Jul 07 22:48:10 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:11 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 1 in 1.041s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:48:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:11 devstack sudo[101378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2
Jul 07 22:48:11 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:11 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" returned: 0 in 1.067s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:11 devstack sudo[101384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb
Jul 07 22:48:11 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:12 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" returned: 0 in 0.965s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-b484fb24-5e00-4344-8d81-fdc7fef8e8a2" released by "delete_volume" :: held 2.996s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Created reservations ['a8ac7acf-f498-4a70-a35a-1907a2fa9ac5', 'b36fa76c-390b-4561-9001-ac2416d91590', '7b8f9004-b132-4d57-a2a3-ef10726c4601', 'f3d6f36b-4d30-4206-b554-11244ae31e47'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:12 devstack sudo[101387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:12 devstack sudo[101387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:12 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" returned: 0 in 0.899s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-quobyte-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb" released by "delete_volume" :: held 2.074s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Created reservations ['2b7eecff-95ce-4384-ad40-85464d1364b6', '09674bb1-2968-42e5-8ed6-f22efa69bb27', '03a9f6c1-06aa-444f-ab85-20059637bcfb', '2550a001-285a-46d4-8ec6-ee6f50654fac'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:12 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:12 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:13 devstack sudo[101387]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.076s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Deleted volume successfully.
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Flow 'volume_create_manager' (b984b58c-c74e-474d-9d9c-f1c70ada3b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1eca75-ab61-4104-b926-8744478df178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95aa6447-0e26-49b2-827e-dd051b5dc7bd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-b484fb24-5e00-4344-8d81-fdc7fef8e8a2-delete_volume" released by "delete_volume" :: held 4.463s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd1eca75-ab61-4104-b926-8744478df178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-667257553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff07dbd3-499f-4c27-a05f-97765061367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575bc3350ae432e9c0d5ea04c64a69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:13Z,use_quota=True,user_id='e396183402fc486f9257db5700140ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df9c683-61dc-42f9-a0ec-dddc8e573d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1df9c683-61dc-42f9-a0ec-dddc8e573d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10faab40-2c5d-413c-930a-cb2afdb1de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10faab40-2c5d-413c-930a-cb2afdb1de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff07dbd3-499f-4c27-a05f-97765061367d', 'volume_name': 'volume-ff07dbd3-499f-4c27-a05f-97765061367d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7706bdef-d944-4378-892a-cd3c19c9b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7706bdef-d944-4378-892a-cd3c19c9b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd74f871-96c1-4223-92f6-e3cc75dd9eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:13 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Volume ff07dbd3-499f-4c27-a05f-97765061367d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff07dbd3-499f-4c27-a05f-97765061367d', 'volume_size': 1}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-667257553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff07dbd3-499f-4c27-a05f-97765061367d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8575bc3350ae432e9c0d5ea04c64a69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:13Z,use_quota=True,user_id='e396183402fc486f9257db5700140ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Creating volume ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:13 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:13 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d 1073741824
Jul 07 22:48:13 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:13 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.001s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Deleted volume successfully.
Jul 07 22:48:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2dbca208-6b32-4e40-a49d-b37f7c6e5369 tempest-CreateVolumesFromSnapshotTest-1702153669 None] Lock "cinder-4e9d6546-cdc8-4a5b-b931-aa94e4c981bb-delete_volume" released by "delete_volume" :: held 3.445s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:14 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d 1073741824" returned: 0 in 1.153s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:14 devstack sudo[101402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:14 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:15 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.835s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] <== create_volume: return (2047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd74f871-96c1-4223-92f6-e3cc75dd9eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff07dbd3-499f-4c27-a05f-97765061367d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c41a61-34a6-4ef0-9a27-587993440fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Volume volume-ff07dbd3-499f-4c27-a05f-97765061367d (ff07dbd3-499f-4c27-a05f-97765061367d): created successfully
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c41a61-34a6-4ef0-9a27-587993440fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Flow 'volume_create_manager' (b984b58c-c74e-474d-9d9c-f1c70ada3b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4b156273-a82d-44f2-ba9a-d9dae4f06175 tempest-VolumesExtendTest-1736736842 None] Created volume successfully.
Jul 07 22:48:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Creating offline snapshot cde6d383-e808-4f8c-af23-719aaa3a096f of volume ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:48:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56b04c-7db8-4977-90c0-c78e8fbc23d9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:17 devstack sudo[101407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:17 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:17 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.991s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:18 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f 1G
Jul 07 22:48:18 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:19 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f 1G" returned: 0 in 1.080s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff07dbd3-499f-4c27-a05f-97765061367d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:19 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff07dbd3-499f-4c27-a05f-97765061367d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f
Jul 07 22:48:19 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:20 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff07dbd3-499f-4c27-a05f-97765061367d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f" returned: 0 in 0.963s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:20 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f is being set with open permissions: ugo+rw
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:20 devstack sudo[101425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f
Jul 07 22:48:20 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:INSERT=46,cinder:UPDATE=182,cinder:SELECT=125,cinder:DELETE=17 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Flow 'volume_create_manager' (107b44b7-fda0-484f-8bb5-731643103ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffc1f38-eec5-44f1-90e5-beaed657bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ffc1f38-eec5-44f1-90e5-beaed657bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-946305180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6632f841-170d-4d0d-a3ee-b5fff00d349d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bd5e4ecc3145629e485719b39f76ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:20Z,use_quota=True,user_id='9040f90ff5ad4bdb9eda983e4ea06d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39a39b-bd85-4ef2-bf74-719b3215a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d39a39b-bd85-4ef2-bf74-719b3215a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deed4af1-e676-4409-aeba-82cec9edf204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deed4af1-e676-4409-aeba-82cec9edf204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6632f841-170d-4d0d-a3ee-b5fff00d349d', 'volume_name': 'volume-6632f841-170d-4d0d-a3ee-b5fff00d349d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c413eed2-5cad-408a-9b75-a742dc274a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c413eed2-5cad-408a-9b75-a742dc274a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449cf1c7-a410-489f-9676-54eb9fe26613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Volume 6632f841-170d-4d0d-a3ee-b5fff00d349d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6632f841-170d-4d0d-a3ee-b5fff00d349d', 'volume_size': 1}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:20 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f" returned: 0 in 0.902s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:20 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info
Jul 07 22:48:20 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:21 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info" returned: 0 in 0.886s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:21 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info is being set with open permissions: ugo+rw
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:21 devstack sudo[101431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info
Jul 07 22:48:21 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (7f13dc2e-b136-4bed-a122-01b9ed54b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073131d9-5be8-4536-a990-ac0f11cfa569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (073131d9-5be8-4536-a990-ac0f11cfa569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1338937960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3172575-546c-4c01-a2d9-b082fd7b2051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:22Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee705987-23c4-4695-b20c-75eb3b2c9a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee705987-23c4-4695-b20c-75eb3b2c9a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01acd6da-c718-4425-ba3f-78dc79b6646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01acd6da-c718-4425-ba3f-78dc79b6646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3172575-546c-4c01-a2d9-b082fd7b2051', 'volume_name': 'volume-a3172575-546c-4c01-a2d9-b082fd7b2051', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0448ca3e-aa66-4052-afed-c006c3bbd207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0448ca3e-aa66-4052-afed-c006c3bbd207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9278f656-4f84-4218-abac-c773c0e45120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Volume a3172575-546c-4c01-a2d9-b082fd7b2051: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3172575-546c-4c01-a2d9-b082fd7b2051', 'volume_size': 1}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (471f6773-44ae-4e52-b1e5-a64fd65ad370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beb602c-c387-4178-9b3c-bc8f9635c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5beb602c-c387-4178-9b3c-bc8f9635c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106504150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12d445-aa63-441e-97f5-2cfeca334b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:23Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6b0eb0-a850-4abe-aa27-614b021a21ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b6b0eb0-a850-4abe-aa27-614b021a21ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50d858d-28e7-4f6d-82c4-6a9f01b80fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e50d858d-28e7-4f6d-82c4-6a9f01b80fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc12d445-aa63-441e-97f5-2cfeca334b48', 'volume_name': 'volume-cc12d445-aa63-441e-97f5-2cfeca334b48', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa72b56-a145-470a-bfeb-9520986192a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa72b56-a145-470a-bfeb-9520986192a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c56ae37-b589-4ecb-9ccb-89931376dc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Volume cc12d445-aa63-441e-97f5-2cfeca334b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc12d445-aa63-441e-97f5-2cfeca334b48', 'volume_size': 1}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:22 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.info" returned: 0 in 0.954s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.898s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.307s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-946305180',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6632f841-170d-4d0d-a3ee-b5fff00d349d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bd5e4ecc3145629e485719b39f76ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:20Z,use_quota=True,user_id='9040f90ff5ad4bdb9eda983e4ea06d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Creating volume 6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:22 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:22 devstack sudo[101434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d 1073741824
Jul 07 22:48:22 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-29b7f8f5-69dd-4a95-90d5-c30fb4bb2530 tempest-VolumesExtendTest-1736736842 None] Create snapshot completed successfully
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (212723c5-7ccb-4303-a2b1-729921597ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7b763-408d-48c9-82d3-a6314ff09581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b7b763-408d-48c9-82d3-a6314ff09581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431207559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06305a-a7ae-4f93-a59b-cf74a72ba3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:23Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6490bb39-a384-4d09-86f5-b8a382a410c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6490bb39-a384-4d09-86f5-b8a382a410c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee99ec2-8aec-40be-8610-6f2d98b3ca00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bee99ec2-8aec-40be-8610-6f2d98b3ca00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a06305a-a7ae-4f93-a59b-cf74a72ba3af', 'volume_name': 'volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4102e6-6ab7-4736-ad31-09c83ade216d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4102e6-6ab7-4736-ad31-09c83ade216d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fceee7-b5e5-4dd3-8992-93311f794d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Volume 1a06305a-a7ae-4f93-a59b-cf74a72ba3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af', 'volume_size': 1}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (31d6d46a-e278-4247-b3ce-670e57d26aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c2675-2feb-46aa-ad7d-e0df7dde73cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (399c2675-2feb-46aa-ad7d-e0df7dde73cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113386819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def0f92d-55e1-4f4f-85e2-9ccebae6c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:24Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6250fd6a-a389-491b-b217-c48d526162d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6250fd6a-a389-491b-b217-c48d526162d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a52e51-85c2-4f14-83b9-48744ca330a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a52e51-85c2-4f14-83b9-48744ca330a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'def0f92d-55e1-4f4f-85e2-9ccebae6c404', 'volume_name': 'volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c21912-ff0c-442e-bd77-059b4de67c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c21912-ff0c-442e-bd77-059b4de67c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71affb1a-ee6a-4cca-8264-6bf1c30a200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Volume def0f92d-55e1-4f4f-85e2-9ccebae6c404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404', 'volume_size': 1}
Jul 07 22:48:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (e40fe605-721a-4c0e-8a3c-c3e92349f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf61cc5-a0e0-4bb8-9ea6-a36431d49b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edf61cc5-a0e0-4bb8-9ea6-a36431d49b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435210604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110bcc34-8812-4242-8362-21445ffc54be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:24Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb1e904-caa3-4605-bbb8-8d357be83507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb1e904-caa3-4605-bbb8-8d357be83507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef77386-ce3f-4c08-9bb7-0422534b3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef77386-ce3f-4c08-9bb7-0422534b3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '110bcc34-8812-4242-8362-21445ffc54be', 'volume_name': 'volume-110bcc34-8812-4242-8362-21445ffc54be', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1a0733-379c-456f-b78c-fd76688bf23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c1a0733-379c-456f-b78c-fd76688bf23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2767b68-765e-4048-8c52-c0ae07d53fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Volume 110bcc34-8812-4242-8362-21445ffc54be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-110bcc34-8812-4242-8362-21445ffc54be', 'volume_size': 1}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:24 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d 1073741824" returned: 0 in 1.278s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:24 devstack sudo[101439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:24 devstack sudo[101439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:24 devstack sudo[101439]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 0.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] <== create_volume: return (2032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.040s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.842s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1338937960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3172575-546c-4c01-a2d9-b082fd7b2051,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:22Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Creating volume a3172575-546c-4c01-a2d9-b082fd7b2051 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:24 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449cf1c7-a410-489f-9676-54eb9fe26613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6632f841-170d-4d0d-a3ee-b5fff00d349d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 1073741824
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babb5aa-2b21-46ea-919c-b8097d68c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:24 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:24 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Volume volume-6632f841-170d-4d0d-a3ee-b5fff00d349d (6632f841-170d-4d0d-a3ee-b5fff00d349d): created successfully
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7babb5aa-2b21-46ea-919c-b8097d68c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:24 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Flow 'volume_create_manager' (107b44b7-fda0-484f-8bb5-731643103ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:24 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4d37b33e-d135-408f-84d6-537354521caf tempest-VolumeDependencyTests-893050123 None] Created volume successfully.
Jul 07 22:48:25 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 1073741824" returned: 0 in 0.971s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:25 devstack sudo[101449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051
Jul 07 22:48:25 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:26 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051" returned: 0 in 0.753s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.973s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1106504150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc12d445-aa63-441e-97f5-2cfeca334b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:23Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Creating volume cc12d445-aa63-441e-97f5-2cfeca334b48 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:26 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:26 devstack sudo[101452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 1073741824
Jul 07 22:48:26 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9278f656-4f84-4218-abac-c773c0e45120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3172575-546c-4c01-a2d9-b082fd7b2051', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ab1666-69bc-4529-9263-651df038b924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Volume volume-a3172575-546c-4c01-a2d9-b082fd7b2051 (a3172575-546c-4c01-a2d9-b082fd7b2051): created successfully
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ab1666-69bc-4529-9263-651df038b924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (7f13dc2e-b136-4bed-a122-01b9ed54b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-67a77c60-27bc-4595-95ba-6bb0b5509802 tempest-CreateVolumesFromImageTest-1376498169 None] Created volume successfully.
Jul 07 22:48:27 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 1073741824" returned: 0 in 1.106s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:27 devstack sudo[101458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48
Jul 07 22:48:27 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Flow 'volume_create_manager' (8283f661-27ab-49ef-949d-43b29b955e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73168f96-d514-4e52-9d86-7ee93e9d856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73168f96-d514-4e52-9d86-7ee93e9d856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575351794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3aeb803-8cce-45cf-81cf-bb077924bfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac2f379b14042f3afe2f435f01ae587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:28Z,use_quota=True,user_id='e8c5a2c38c4440bd93c3e36c31e1e4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c22c9-0cc4-482d-b01e-355bab3326ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044c22c9-0cc4-482d-b01e-355bab3326ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bff6cb-c907-4f8b-ba8b-b545ca168323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bff6cb-c907-4f8b-ba8b-b545ca168323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3aeb803-8cce-45cf-81cf-bb077924bfd6', 'volume_name': 'volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8f5772-5753-481b-b8e4-d49b2da589bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8f5772-5753-481b-b8e4-d49b2da589bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183e1239-ee8a-42b2-9c60-0971afd749de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Volume f3aeb803-8cce-45cf-81cf-bb077924bfd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6', 'volume_size': 1}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48" returned: 0 in 0.729s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.428s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1431207559',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a06305a-a7ae-4f93-a59b-cf74a72ba3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:23Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Creating volume 1a06305a-a7ae-4f93-a59b-cf74a72ba3af {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:28 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:28 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af 1073741824
Jul 07 22:48:28 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c56ae37-b589-4ecb-9ccb-89931376dc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc12d445-aa63-441e-97f5-2cfeca334b48', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413f567c-9842-4533-a7f8-9544c3dbd818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Volume volume-cc12d445-aa63-441e-97f5-2cfeca334b48 (cc12d445-aa63-441e-97f5-2cfeca334b48): created successfully
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413f567c-9842-4533-a7f8-9544c3dbd818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (471f6773-44ae-4e52-b1e5-a64fd65ad370) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-06e97722-9851-42c7-9ba6-0c09eb368a20 tempest-CreateVolumesFromImageTest-1376498169 None] Created volume successfully.
Jul 07 22:48:29 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af 1073741824" returned: 0 in 0.932s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:29 devstack sudo[101467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af
Jul 07 22:48:29 devstack sudo[101467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:30 devstack sudo[101467]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" returned: 0 in 0.629s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.538s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fceee7-b5e5-4dd3-8992-93311f794d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6716ce5-994c-4467-a609-3504696f29bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8203e4-b486-40f6-acdd-206531d1bc5a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Volume volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af (1a06305a-a7ae-4f93-a59b-cf74a72ba3af): created successfully
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6716ce5-994c-4467-a609-3504696f29bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (212723c5-7ccb-4303-a2b1-729921597ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-be47d0b6-1e35-4c56-b22e-6bb9e7872482 tempest-CreateVolumesFromImageTest-1376498169 None] Created volume successfully.
Jul 07 22:48:30 devstack sudo[101470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:30 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:31 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f 2G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f 2G" returned: 0 in 0.140s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.974s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.319s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2113386819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=def0f92d-55e1-4f4f-85e2-9ccebae6c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:24Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Creating volume def0f92d-55e1-4f4f-85e2-9ccebae6c404 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:31 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:31 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 1073741824
Jul 07 22:48:31 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-74f43f92-6673-4540-80ce-b0a409224a3f tempest-VolumesExtendTest-1736736842 None] Extend volume completed successfully.
Jul 07 22:48:32 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 1073741824" returned: 0 in 0.851s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:32 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404
Jul 07 22:48:32 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-cde6d383-e808-4f8c-af23-719aaa3a096f-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-cde6d383-e808-4f8c-af23-719aaa3a096f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-quobyte-cde6d383-e808-4f8c-af23-719aaa3a096f" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-cde6d383-e808-4f8c-af23-719aaa3a096f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Deleting offline snapshot cde6d383-e808-4f8c-af23-719aaa3a096f of volume ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] snapshot_file for this snap is: volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3bbf50-3cdc-4069-a2d4-2d49918f19e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:32 devstack sudo[101486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f
Jul 07 22:48:32 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:32 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404" returned: 0 in 0.676s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.642s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1435210604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=110bcc34-8812-4242-8362-21445ffc54be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d989414570204f18808bf2e73f9fc106',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:24Z,use_quota=True,user_id='ec9c8c5780d74510997ab2c534676b6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Creating volume 110bcc34-8812-4242-8362-21445ffc54be {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:32 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:32 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be 1073741824
Jul 07 22:48:32 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71affb1a-ee6a-4cca-8264-6bf1c30a200c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5171b9e3-6344-4b1d-8dc2-fa34aebfeb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Volume volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 (def0f92d-55e1-4f4f-85e2-9ccebae6c404): created successfully
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5171b9e3-6344-4b1d-8dc2-fa34aebfeb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (31d6d46a-e278-4247-b3ce-670e57d26aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b7f17adf-13cd-4d1b-bc6a-8a4e27b56d77 tempest-CreateVolumesFromImageTest-1376498169 None] Created volume successfully.
Jul 07 22:48:33 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f" returned: 0 in 0.861s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff07dbd3-499f-4c27-a05f-97765061367d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[51495b06-8935-4841-bd61-e0e5ed3df17e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:33 devstack sudo[101494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:33 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:33 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be 1073741824" returned: 0 in 0.958s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:33 devstack sudo[101499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be
Jul 07 22:48:33 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:33 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:33 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:34 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.825s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:34 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f
Jul 07 22:48:34 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:34 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.315s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Creating offline snapshot 689acc4e-3b5b-4408-8eb5-c855a1aa12f7 of volume 6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2767b68-765e-4048-8c52-c0ae07d53fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-110bcc34-8812-4242-8362-21445ffc54be', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b6e4cb-03cf-467f-88c3-c5f3a5dd397b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[27eccb0c-0dff-4c35-aa3d-b27eae2246e2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:34 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Volume volume-110bcc34-8812-4242-8362-21445ffc54be (110bcc34-8812-4242-8362-21445ffc54be): created successfully
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b6e4cb-03cf-467f-88c3-c5f3a5dd397b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Flow 'volume_create_manager' (e40fe605-721a-4c0e-8a3c-c3e92349f20a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5245c819-70ba-4811-81a7-3cd57019759e tempest-CreateVolumesFromImageTest-1376498169 None] Created volume successfully.
Jul 07 22:48:34 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.696s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:48:34 devstack sudo[101510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:34 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:34 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f" returned: 0 in 0.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:34 devstack sudo[101515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f
Jul 07 22:48:34 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-110bcc34-8812-4242-8362-21445ffc54be-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-110bcc34-8812-4242-8362-21445ffc54be-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-quobyte-110bcc34-8812-4242-8362-21445ffc54be" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-110bcc34-8812-4242-8362-21445ffc54be" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f320a181-7164-4901-824b-eb4df8f40ecb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:35 devstack sudo[101517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be
Jul 07 22:48:35 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:35 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:35 devstack sudo[101522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 1G
Jul 07 22:48:35 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:35 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d.cde6d383-e808-4f8c-af23-719aaa3a096f" returned: 0 in 0.715s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-cde6d383-e808-4f8c-af23-719aaa3a096f" released by "_delete_snapshot" :: held 3.319s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" released by "delete_snapshot" :: held 3.353s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Created reservations ['883dc42a-cf2f-4a6b-89c9-ca12180c64bb', '25150c71-5313-4b2f-bc02-2f4bd0c57ef5', '86508c5e-3a1a-469e-a2f0-97ef449a1695', 'c3c249d4-01a5-4961-8301-5ab5de1d4c62'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Delete snapshot completed successfully.
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a23fda5c-9fd7-46ea-8799-cfb46a9ac9cd tempest-VolumesExtendTest-1736736842 None] Lock "cinder-cde6d383-e808-4f8c-af23-719aaa3a096f-delete_snapshot" released by "delete_snapshot" :: held 3.521s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:35 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:35 devstack sudo[101532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be
Jul 07 22:48:35 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 1G" returned: 0 in 0.829s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6632f841-170d-4d0d-a3ee-b5fff00d349d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack sudo[101535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6632f841-170d-4d0d-a3ee-b5fff00d349d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:36 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-110bcc34-8812-4242-8362-21445ffc54be" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-ff07dbd3-499f-4c27-a05f-97765061367d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-110bcc34-8812-4242-8362-21445ffc54be" released by "delete_volume" :: held 1.592s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "cinder-ff07dbd3-499f-4c27-a05f-97765061367d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Created reservations ['1438de16-ad13-413c-a040-485a13926c69', 'a33e8e1e-a050-47c2-95ca-3bda231360ba', 'efbd004e-17ee-4b2a-913b-a9fd5e5e3c98', '90fc8ebe-819e-4a3a-8dd1-aa78dd6b41da'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8b6278-18c6-44c4-8331-677541114e42]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:36 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6632f841-170d-4d0d-a3ee-b5fff00d349d -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:36 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 is being set with open permissions: ugo+rw
Jul 07 22:48:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:36 devstack sudo[101542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:36 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:36 devstack sudo[101545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:36 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-def0f92d-55e1-4f4f-85e2-9ccebae6c404-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-def0f92d-55e1-4f4f-85e2-9ccebae6c404-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-quobyte-def0f92d-55e1-4f4f-85e2-9ccebae6c404" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-def0f92d-55e1-4f4f-85e2-9ccebae6c404" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[123eb09c-88f1-4bd9-b279-4ec5a148284a]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:37 devstack sudo[101548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404
Jul 07 22:48:37 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.913s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:37 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Deleted volume successfully.
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:37 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d
Jul 07 22:48:37 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-47286d56-2f86-4463-8c97-67e297c19930 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-110bcc34-8812-4242-8362-21445ffc54be-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:37 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info
Jul 07 22:48:37 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:38 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404" returned: 0 in 0.866s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:38 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404
Jul 07 22:48:38 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:38 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ff07dbd3-499f-4c27-a05f-97765061367d" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "cinder-quobyte-ff07dbd3-499f-4c27-a05f-97765061367d" released by "delete_volume" :: held 1.742s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:38 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info" returned: 0 in 0.731s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:38 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info is being set with open permissions: ugo+rw
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:38 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info
Jul 07 22:48:38 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Created reservations ['cf3b5728-875e-4535-aafd-f09b19e04b83', '39ace651-6e6d-4e9d-b87d-5ce57e5c9e4b', '2b5da6ce-66e5-4bb0-bb62-a3f0fc377342', '437b1f8d-f8bf-4370-a552-2dd0d05be124'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:38 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:38 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:38 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-def0f92d-55e1-4f4f-85e2-9ccebae6c404" returned: 0 in 0.725s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-def0f92d-55e1-4f4f-85e2-9ccebae6c404" released by "delete_volume" :: held 1.653s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Created reservations ['9a9900e3-7cbf-4333-a5c4-7268ce922c81', 'f452d3c5-7593-42fa-9548-1be621d2358d', 'c4e232ea-b53c-46be-bca6-ac4d00b2b22c', '6b663e6c-e193-4508-972e-701167318671'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:39 devstack sudo[101578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:39 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:39 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.info" returned: 0 in 0.752s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.892s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.759s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-575351794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3aeb803-8cce-45cf-81cf-bb077924bfd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ac2f379b14042f3afe2f435f01ae587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:28Z,use_quota=True,user_id='e8c5a2c38c4440bd93c3e36c31e1e4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Creating volume f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:39 devstack sudo[101581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 1073741824
Jul 07 22:48:39 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5e931fae-689b-4f18-aef3-cebdc38a18fd tempest-VolumeDependencyTests-893050123 None] Create snapshot completed successfully
Jul 07 22:48:39 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Deleted volume successfully.
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7bb6dec8-d3b8-4506-84dd-d3dd6f094c19 tempest-VolumesExtendTest-1736736842 None] Lock "cinder-ff07dbd3-499f-4c27-a05f-97765061367d-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-1a06305a-a7ae-4f93-a59b-cf74a72ba3af-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-1a06305a-a7ae-4f93-a59b-cf74a72ba3af-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-quobyte-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[12977394-1a6a-49fa-8335-dc14d023c9e5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:40 devstack sudo[101583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af
Jul 07 22:48:40 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:40 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.926s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Deleted volume successfully.
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f9294940-26ba-4038-9cb6-99705f04d543 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-def0f92d-55e1-4f4f-85e2-9ccebae6c404-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Flow 'volume_create_manager' (e74a37ca-125f-4fc2-8d9b-0f263b795ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd1b251-29b3-46cb-beb4-5875d4aef1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afd1b251-29b3-46cb-beb4-5875d4aef1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-42978245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5683414-81d4-4d9e-b5a1-b1d27b1c5d87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94bd5e4ecc3145629e485719b39f76ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=689acc4e-3b5b-4408-8eb5-c855a1aa12f7,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:41Z,use_quota=True,user_id='9040f90ff5ad4bdb9eda983e4ea06d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b525d415-8fb3-42e2-a0e0-f27f3b5e438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b525d415-8fb3-42e2-a0e0-f27f3b5e438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43dda4c-e243-4f90-b5e5-c338aa8d9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43dda4c-e243-4f90-b5e5-c338aa8d9b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5683414-81d4-4d9e-b5a1-b1d27b1c5d87', 'volume_name': 'volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87', 'volume_size': 1, 'snapshot_id': '689acc4e-3b5b-4408-8eb5-c855a1aa12f7'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901ba21e-357a-41f6-8393-33cddf37296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:40 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (901ba21e-357a-41f6-8393-33cddf37296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e621ce5f-69ce-43f6-9981-859b08f9bda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Volume b5683414-81d4-4d9e-b5a1-b1d27b1c5d87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87', 'volume_size': 1, 'snapshot_id': '689acc4e-3b5b-4408-8eb5-c855a1aa12f7'}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 1073741824" returned: 0 in 1.489s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:40 devstack sudo[101593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:48:40 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:41 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" returned: 0 in 1.161s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:41 devstack sudo[101596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af
Jul 07 22:48:41 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:41 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.772s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] <== create_volume: return (2318ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.322s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.811s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183e1239-ee8a-42b2-9c60-0971afd749de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48a9dfe-c8c2-4c91-b8bc-a0ef4b7ee20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Creating volume b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 from snapshot 689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:41 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Volume volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 (f3aeb803-8cce-45cf-81cf-bb077924bfd6): created successfully
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48a9dfe-c8c2-4c91-b8bc-a0ef4b7ee20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Flow 'volume_create_manager' (8283f661-27ab-49ef-949d-43b29b955e22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] snapshot: 689acc4e-3b5b-4408-8eb5-c855a1aa12f7, volume: b5683414-81d4-4d9e-b5a1-b1d27b1c5d87,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-910ed4b3-1af4-4553-9c78-5bfa4f3c6f7f tempest-VolumesActionsTest-1513216216 None] Created volume successfully.
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-1a06305a-a7ae-4f93-a59b-cf74a72ba3af" released by "delete_volume" :: held 2.017s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[218be510-2d53-43e1-aa8f-0fe5dae03756]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Created reservations ['8abd616b-bc82-4ebf-b265-ead3c687585e', 'f26bab6b-0ee8-4af4-ae2e-d619dadfb128', 'd87b995a-a39d-4479-a624-43e9ecb21692', '1e93ca83-988d-4ea0-a567-4502214c816a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:42 devstack sudo[101600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:42 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:42 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:42 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:42 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 1.018s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6632f841-170d-4d0d-a3ee-b5fff00d349d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:48:42 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.832s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Deleted volume successfully.
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7ee34a-0043-4f61-a845-03cc54403b86]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3914214f-06ee-42b9-b16a-418bb28af7fd tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-1a06305a-a7ae-4f93-a59b-cf74a72ba3af-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:43 devstack sudo[101608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:43 devstack sudo[101608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-cc12d445-aa63-441e-97f5-2cfeca334b48-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (e8072870-bac6-4073-8bea-28ded1a037cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f01400-f9a3-40d8-b3e7-4ac28513e07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-cc12d445-aa63-441e-97f5-2cfeca334b48-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f01400-f9a3-40d8-b3e7-4ac28513e07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-314577170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6203869c-26e6-46b2-b173-d8a7b16707d3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:43Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc344ea-5745-42fd-b217-f83a3bf5e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cc344ea-5745-42fd-b217-f83a3bf5e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a141fb3-fd56-4981-99ac-e696cbe51dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a141fb3-fd56-4981-99ac-e696cbe51dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6203869c-26e6-46b2-b173-d8a7b16707d3', 'volume_name': 'volume-6203869c-26e6-46b2-b173-d8a7b16707d3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf22b91-1add-4546-9982-71a1036c166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebf22b91-1add-4546-9982-71a1036c166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ebdf0-e333-43cd-8c84-c76c1e3adf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:43 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Volume 6203869c-26e6-46b2-b173-d8a7b16707d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6203869c-26e6-46b2-b173-d8a7b16707d3', 'volume_size': 1}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-quobyte-cc12d445-aa63-441e-97f5-2cfeca334b48" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-cc12d445-aa63-441e-97f5-2cfeca334b48" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd8db3-666f-4762-b131-ceb44bcf0fc8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:43 devstack sudo[101610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48
Jul 07 22:48:43 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:43 devstack sudo[101608]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 0.906s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:48:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:43 devstack sudo[101615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87
Jul 07 22:48:43 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:44 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48" returned: 0 in 0.903s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:44 devstack sudo[101623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48
Jul 07 22:48:44 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:45 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc12d445-aa63-441e-97f5-2cfeca334b48" returned: 0 in 0.888s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-cc12d445-aa63-441e-97f5-2cfeca334b48" released by "delete_volume" :: held 1.866s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Created reservations ['c39fa6f9-298f-462f-b639-30939c9fba7d', 'a3df362f-e814-4a45-ac22-442a23d43883', '91a44b60-d9be-4638-8b0a-45d30748cfdc', '752a6099-9a8c-405f-b9e7-3c057966c1ac'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:45 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:45 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-a3172575-546c-4c01-a2d9-b082fd7b2051-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-a3172575-546c-4c01-a2d9-b082fd7b2051-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "cinder-quobyte-a3172575-546c-4c01-a2d9-b082fd7b2051" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-a3172575-546c-4c01-a2d9-b082fd7b2051" acquired by "delete_volume" :: waited 0.044s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:46 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cb50a8-6ca7-409c-bb44-c98851c9b858]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:46 devstack sudo[101639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051
Jul 07 22:48:46 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:47 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.261s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:47 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Deleted volume successfully.
Jul 07 22:48:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bf0fe8f4-8752-4fb6-befe-c313cf69d067 tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-cc12d445-aa63-441e-97f5-2cfeca334b48-delete_volume" released by "delete_volume" :: held 4.642s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:47 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051" returned: 0 in 1.911s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:48 devstack sudo[101646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051
Jul 07 22:48:48 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:49 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a3172575-546c-4c01-a2d9-b082fd7b2051" returned: 0 in 1.870s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-quobyte-a3172575-546c-4c01-a2d9-b082fd7b2051" released by "delete_volume" :: held 3.948s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Created reservations ['b821bf90-e833-4699-a86f-9d4154a59b02', 'a98629fb-ef74-4709-84d0-ed9bf28c672b', 'a70bb990-987d-4e05-aac0-7ac2ca04abcb', 'b0ad0cef-c9bf-4590-979e-3792d10022e6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:50 devstack sudo[101649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:48:50 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:50 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" returned: 0 in 6.410s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d00e61a-035e-4648-8820-8907ea0b9a01]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:50 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:50 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:51 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.907s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:48:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Deleted volume successfully.
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2c22bd5-19b1-44ab-8005-9347bf7a263e tempest-CreateVolumesFromImageTest-1376498169 None] Lock "cinder-a3172575-546c-4c01-a2d9-b082fd7b2051-delete_volume" released by "delete_volume" :: held 5.296s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:51 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 1.305s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:48:51 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Converted 1024.00 MB image at 159.71 MB/s
Jul 07 22:48:51 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 is being set with open permissions: ugo+rw
Jul 07 22:48:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:51 devstack sudo[101658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87
Jul 07 22:48:51 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:52 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" released by "_copy_volume_from_snapshot" :: held 10.620s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" released by "_create_volume_from_snapshot" :: held 10.681s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.722s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.169s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-314577170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6203869c-26e6-46b2-b173-d8a7b16707d3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:43Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Creating volume 6203869c-26e6-46b2-b173-d8a7b16707d3 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:52 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:52 devstack sudo[101675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 1073741824
Jul 07 22:48:52 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e621ce5f-69ce-43f6-9981-859b08f9bda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87', 'volume_size': 1, 'snapshot_id': '689acc4e-3b5b-4408-8eb5-c855a1aa12f7'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff564e-0567-4d62-b25d-a7c998aa6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Volume volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 (b5683414-81d4-4d9e-b5a1-b1d27b1c5d87): created successfully
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dff564e-0567-4d62-b25d-a7c998aa6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Flow 'volume_create_manager' (e74a37ca-125f-4fc2-8d9b-0f263b795ba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a109860f-1c7e-4036-b9eb-97e1df7f0bec tempest-VolumeDependencyTests-893050123 None] Created volume successfully.
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Deleting offline snapshot 689acc4e-3b5b-4408-8eb5-c855a1aa12f7 of volume 6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] snapshot_file for this snap is: volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68b8293-ed15-44e1-af50-ea62748a9e71]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:53 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:53 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:53 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 1073741824" returned: 0 in 1.211s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:53 devstack sudo[101687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3
Jul 07 22:48:53 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:54 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 1.013s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6632f841-170d-4d0d-a3ee-b5fff00d349d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3ab9b3-c451-472f-bdee-df1958c4a077]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:54 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3" returned: 0 in 0.816s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ebdf0-e333-43cd-8c84-c76c1e3adf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6203869c-26e6-46b2-b173-d8a7b16707d3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234eaf36-9717-4495-84ca-09bd1672449f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Volume volume-6203869c-26e6-46b2-b173-d8a7b16707d3 (6203869c-26e6-46b2-b173-d8a7b16707d3): created successfully
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234eaf36-9717-4495-84ca-09bd1672449f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (e8072870-bac6-4073-8bea-28ded1a037cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2c2c67eb-6d30-4591-aa79-fd2b8e4275fa tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:48:54 devstack sudo[101693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:54 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (1aa7c52c-44e7-4847-b3ad-1d015b5c2d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da32165-c0ae-4d7d-8099-521b4a6ce8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2da32165-c0ae-4d7d-8099-521b4a6ce8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21254911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c73f3-2dd6-48f4-9eec-2b768f8be483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:55Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2290e992-b10e-4c09-b7ed-743edda55105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2290e992-b10e-4c09-b7ed-743edda55105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4a1194-41ca-4c9e-be4b-feddbadd3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c4a1194-41ca-4c9e-be4b-feddbadd3e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395c73f3-2dd6-48f4-9eec-2b768f8be483', 'volume_name': 'volume-395c73f3-2dd6-48f4-9eec-2b768f8be483', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926d3112-a20b-4167-8be1-c89f6a42cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926d3112-a20b-4167-8be1-c89f6a42cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db4d43f-9ab9-4752-b448-d71fb89cc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:55 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume 395c73f3-2dd6-48f4-9eec-2b768f8be483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395c73f3-2dd6-48f4-9eec-2b768f8be483', 'volume_size': 1}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-21254911',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395c73f3-2dd6-48f4-9eec-2b768f8be483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:55Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume 395c73f3-2dd6-48f4-9eec-2b768f8be483 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:55 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:55 devstack sudo[101696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 1073741824
Jul 07 22:48:55 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:55 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 0.938s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:55 devstack sudo[101701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:55 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:56 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 1073741824" returned: 0 in 1.055s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:56 devstack sudo[101709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483
Jul 07 22:48:56 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (308553a2-cbd4-4383-8e2d-ba0e4b2f9726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa760f3-80da-494a-9b1a-32a4ef8a476f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aa760f3-80da-494a-9b1a-32a4ef8a476f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406547328',display_name='tempest-VolumesGetTest-Volume-216452931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3997bd8b-872b-446b-ba02-61c396b48bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:56Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c4038f-3079-4361-a3db-efe13c04d8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c4038f-3079-4361-a3db-efe13c04d8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647598cc-4eba-49fe-9a46-11a8a58f9601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647598cc-4eba-49fe-9a46-11a8a58f9601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3997bd8b-872b-446b-ba02-61c396b48bf0', 'volume_name': 'volume-3997bd8b-872b-446b-ba02-61c396b48bf0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce91123-e208-4ae1-b6e7-82765ed6ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dce91123-e208-4ae1-b6e7-82765ed6ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00657b2d-9972-4863-ad46-d693df6438a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Volume 3997bd8b-872b-446b-ba02-61c396b48bf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3997bd8b-872b-446b-ba02-61c396b48bf0', 'volume_size': 1}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:56 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 1.261s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:56 devstack sudo[101739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7
Jul 07 22:48:56 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:57 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483" returned: 0 in 1.144s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1406547328',display_name='tempest-VolumesGetTest-Volume-216452931',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3997bd8b-872b-446b-ba02-61c396b48bf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:56Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Creating volume 3997bd8b-872b-446b-ba02-61c396b48bf0 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:48:57 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:57 devstack sudo[101760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 1073741824
Jul 07 22:48:57 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db4d43f-9ab9-4752-b448-d71fb89cc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395c73f3-2dd6-48f4-9eec-2b768f8be483', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178e0429-0e15-4f1c-8046-bf625ee04f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 (395c73f3-2dd6-48f4-9eec-2b768f8be483): created successfully
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (178e0429-0e15-4f1c-8046-bf625ee04f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (1aa7c52c-44e7-4847-b3ad-1d015b5c2d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a6c3420e-0441-4bdc-8b95-ec5ce5100d21 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:48:57 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d.689acc4e-3b5b-4408-8eb5-c855a1aa12f7" returned: 0 in 0.956s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-689acc4e-3b5b-4408-8eb5-c855a1aa12f7" released by "_delete_snapshot" :: held 4.299s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" released by "delete_snapshot" :: held 4.331s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Created reservations ['b53a1572-69d3-424b-987d-629e993bc501', '84dce589-32a5-492e-9401-4c083ac4bb58', '37d53746-4b2e-4bf8-9904-f34f6b189b26', 'd3a62164-49b5-4e8d-869f-ab1580a5a38a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:48:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Delete snapshot completed successfully.
Jul 07 22:48:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-10a05eaf-51cf-4f3d-a42a-e7740e4773f6 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-689acc4e-3b5b-4408-8eb5-c855a1aa12f7-delete_snapshot" released by "delete_snapshot" :: held 4.482s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:48:58 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 1073741824" returned: 0 in 1.143s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:58 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0
Jul 07 22:48:58 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-6632f841-170d-4d0d-a3ee-b5fff00d349d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "cinder-6632f841-170d-4d0d-a3ee-b5fff00d349d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:48:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" acquired by "delete_volume" :: waited 0.045s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c212d884-41f1-4304-b854-d80f8b24f866]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (a88a74a9-8cf6-4a63-a4f8-8b40ef841e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c16566-0aa8-4952-9203-4f49fa21b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43c16566-0aa8-4952-9203-4f49fa21b9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881849653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e2dc63-a0f7-4364-aebc-4402a5d7d614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:59Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6588c-1d5d-44c5-af89-f2609a6cc8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df6588c-1d5d-44c5-af89-f2609a6cc8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255d4d81-f140-494c-be37-5060e33efa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255d4d81-f140-494c-be37-5060e33efa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13e2dc63-a0f7-4364-aebc-4402a5d7d614', 'volume_name': 'volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f963449-b29d-40ca-b2fa-639c34e35a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack sudo[101790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:48:59 devstack sudo[101790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f963449-b29d-40ca-b2fa-639c34e35a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a610db-7c24-4354-9258-ef513f2c37a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume 13e2dc63-a0f7-4364-aebc-4402a5d7d614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614', 'volume_size': 1}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (b56a5488-99cb-4979-8f9f-673c23297891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842fbbaa-fb88-4eb9-aade-d6d9bf5d9b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (842fbbaa-fb88-4eb9-aade-d6d9bf5d9b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201144537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e479d-5380-44bd-b202-09360da58f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:59Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f837a8-c100-45ff-a278-34a98f8073b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f837a8-c100-45ff-a278-34a98f8073b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c447d4e-65bc-471e-9057-2bf9d5547ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c447d4e-65bc-471e-9057-2bf9d5547ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0e479d-5380-44bd-b202-09360da58f6f', 'volume_name': 'volume-be0e479d-5380-44bd-b202-09360da58f6f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c162e59d-edac-46cb-aa39-3376ffe312a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c162e59d-edac-46cb-aa39-3376ffe312a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd941b17-134e-4588-a62d-fc5a86837340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:48:59 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume be0e479d-5380-44bd-b202-09360da58f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0e479d-5380-44bd-b202-09360da58f6f', 'volume_size': 1}
Jul 07 22:48:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (7db60a31-4781-4832-8d82-5e7d9e211f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fac93d-cecc-435b-a21a-fd61cd35e374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73fac93d-cecc-435b-a21a-fd61cd35e374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434435243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2c8854-ceae-4bc7-9e21-d493bf3012d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:00Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dba097-316b-486b-a526-41d780eeebb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76dba097-316b-486b-a526-41d780eeebb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f484010-161e-4349-b5a6-bdef2bc134d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f484010-161e-4349-b5a6-bdef2bc134d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2c8854-ceae-4bc7-9e21-d493bf3012d1', 'volume_name': 'volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a338eb0-c50c-4603-9f1b-af23395952a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a338eb0-c50c-4603-9f1b-af23395952a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e1062-33ec-464c-a8d2-6d8048ab20f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume ce2c8854-ceae-4bc7-9e21-d493bf3012d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1', 'volume_size': 1}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:00 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0" returned: 0 in 1.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] <== create_volume: return (2933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.937s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881849653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e2dc63-a0f7-4364-aebc-4402a5d7d614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:59Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume 13e2dc63-a0f7-4364-aebc-4402a5d7d614 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:00 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:00 devstack sudo[101795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 1073741824
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00657b2d-9972-4863-ad46-d693df6438a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3997bd8b-872b-446b-ba02-61c396b48bf0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21d01a9-cc0b-4d1e-a9d1-6cdc3e6805cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:00 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Volume volume-3997bd8b-872b-446b-ba02-61c396b48bf0 (3997bd8b-872b-446b-ba02-61c396b48bf0): created successfully
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21d01a9-cc0b-4d1e-a9d1-6cdc3e6805cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (308553a2-cbd4-4383-8e2d-ba0e4b2f9726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f56ff8a4-5b6e-4d96-8664-89ef3976ceb0 tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (ddafe6bf-2eb7-4c08-babd-e4bf3d04010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:00 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852be378-2939-4c49-8bfd-38e56d03f250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack sudo[101790]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 2.026s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852be378-2939-4c49-8bfd-38e56d03f250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725219043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f43c66-f0af-41d9-af80-544cb06c784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:01Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0057a94e-b317-4a73-89e7-76bdac41d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack sudo[101834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0057a94e-b317-4a73-89e7-76bdac41d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e4439-44f5-4de5-ae02-0a6d31f54df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa9e4439-44f5-4de5-ae02-0a6d31f54df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70f43c66-f0af-41d9-af80-544cb06c784f', 'volume_name': 'volume-70f43c66-f0af-41d9-af80-544cb06c784f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a4182-3688-4e39-a467-81497e80a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326a4182-3688-4e39-a467-81497e80a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b5d811-843b-4043-898d-d299e50ff0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:01 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume 70f43c66-f0af-41d9-af80-544cb06c784f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70f43c66-f0af-41d9-af80-544cb06c784f', 'volume_size': 1}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-3997bd8b-872b-446b-ba02-61c396b48bf0-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "cinder-3997bd8b-872b-446b-ba02-61c396b48bf0-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-3997bd8b-872b-446b-ba02-61c396b48bf0" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-3997bd8b-872b-446b-ba02-61c396b48bf0" acquired by "delete_volume" :: waited 0.048s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ef381d-55c0-4c55-9578-ad7134dd2397]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-015a9d99-3e88-49e9-8cc8-5b2ee19260ab tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" by "attach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-015a9d99-3e88-49e9-8cc8-5b2ee19260ab tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" acquired by "attach_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (550880d9-7e2d-494f-80c4-a9afaccc8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:02 devstack sudo[101840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0
Jul 07 22:49:02 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775d16fe-d089-45e8-bfa6-d1f1c645e7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (775d16fe-d089-45e8-bfa6-d1f1c645e7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996187954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b97d7da-775d-4037-8c04-41e33dda5ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:02Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d86ab19-cdcb-4856-b92b-ace8341146f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d86ab19-cdcb-4856-b92b-ace8341146f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb37cfa9-d841-4d77-969d-4668e29793b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb37cfa9-d841-4d77-969d-4668e29793b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b97d7da-775d-4037-8c04-41e33dda5ad8', 'volume_name': 'volume-6b97d7da-775d-4037-8c04-41e33dda5ad8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:02 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7a0914-0b4a-4924-84e9-3317b3d6a0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec7a0914-0b4a-4924-84e9-3317b3d6a0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ec0758-a50d-4f4c-9c8e-6b55f02453f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:02 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume 6b97d7da-775d-4037-8c04-41e33dda5ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b97d7da-775d-4037-8c04-41e33dda5ad8', 'volume_size': 1}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 1073741824" returned: 0 in 2.226s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-015a9d99-3e88-49e9-8cc8-5b2ee19260ab tempest-VolumesActionsTest-1513216216 None] Attaching volume f3aeb803-8cce-45cf-81cf-bb077924bfd6 to instance a7e6eacb-8f87-49a8-9e70-5bb62754e907 at mountpoint /dev/vdb on host None.
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-015a9d99-3e88-49e9-8cc8-5b2ee19260ab tempest-VolumesActionsTest-1513216216 None] Attach volume completed successfully.
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-015a9d99-3e88-49e9-8cc8-5b2ee19260ab tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" released by "attach_volume" :: held 0.359s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:02 devstack sudo[101846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614
Jul 07 22:49:02 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:02 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6632f841-170d-4d0d-a3ee-b5fff00d349d" returned: 0 in 1.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-6632f841-170d-4d0d-a3ee-b5fff00d349d" released by "delete_volume" :: held 3.878s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Created reservations ['2d3c432c-0035-4aad-bf82-9361c5027bd7', '8f25480d-32d9-4416-a6da-79bfc358d1eb', '87fa23c5-25bc-4eab-959a-c2eaecd19f04', '3eb9a63a-88d2-4012-a0f1-15ae2ee0d287'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04f2a3d6-4ebc-43f8-ba3d-c2822ad1d19f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" by "detach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04f2a3d6-4ebc-43f8-ba3d-c2822ad1d19f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" acquired by "detach_volume" :: waited 0.053s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-04f2a3d6-4ebc-43f8-ba3d-c2822ad1d19f tempest-VolumesActionsTest-1513216216 None] Detaching volume f3aeb803-8cce-45cf-81cf-bb077924bfd6 from instance a7e6eacb-8f87-49a8-9e70-5bb62754e907.
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack sudo[101853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:03 devstack sudo[101853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-04f2a3d6-4ebc-43f8-ba3d-c2822ad1d19f tempest-VolumesActionsTest-1513216216 None] Detach volume completed successfully.
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04f2a3d6-4ebc-43f8-ba3d-c2822ad1d19f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" released by "detach_volume" :: held 0.253s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:03 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0" returned: 0 in 1.678s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack sudo[101864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0
Jul 07 22:49:03 devstack sudo[101864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:03 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614" returned: 0 in 1.190s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (3502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.508s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.041s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201144537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e479d-5380-44bd-b202-09360da58f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:48:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:48:59Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume be0e479d-5380-44bd-b202-09360da58f6f {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:03 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25a610db-7c24-4354-9258-ef513f2c37a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:03 devstack sudo[101866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f 1073741824
Jul 07 22:49:03 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fa30e-06a2-4679-9ae3-d1a115c61ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 (13e2dc63-a0f7-4364-aebc-4402a5d7d614): created successfully
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e5fa30e-06a2-4679-9ae3-d1a115c61ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (a88a74a9-8cf6-4a63-a4f8-8b40ef841e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-aa3ebba0-498f-4cb3-abe6-9296a1375300 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:49:03 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=122,cinder:INSERT=43,cinder:UPDATE=151,cinder:DELETE=12 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:04 devstack sudo[101853]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" acquired by "delete_volume" :: waited 0.091s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.083s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Deleted volume successfully.
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f004476-c0fb-4b42-b926-4783c6ec1ef7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e636931d-440c-476d-84a7-38d1aecbb51c tempest-VolumeDependencyTests-893050123 None] Lock "cinder-6632f841-170d-4d0d-a3ee-b5fff00d349d-delete_volume" released by "delete_volume" :: held 5.503s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:04 devstack sudo[101869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87
Jul 07 22:49:04 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:04 devstack sudo[101864]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3997bd8b-872b-446b-ba02-61c396b48bf0" returned: 0 in 1.277s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-3997bd8b-872b-446b-ba02-61c396b48bf0" released by "delete_volume" :: held 3.036s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Created reservations ['c840c9f6-8cfb-421f-b6cb-759d0394574d', 'd0b65ae8-8e2a-40c2-b8e6-b49ea9a0cf25', 'aa3a81ce-edb5-4a43-b6c4-575b51061930', 'ff75620d-65db-40fe-8229-ff8a983cee01'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:05 devstack sudo[101876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:05 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-6203869c-26e6-46b2-b173-d8a7b16707d3-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "cinder-6203869c-26e6-46b2-b173-d8a7b16707d3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:05 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" returned: 0 in 1.246s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:05 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f 1073741824" returned: 0 in 1.760s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:05 devstack sudo[101887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87
Jul 07 22:49:05 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-6203869c-26e6-46b2-b173-d8a7b16707d3" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-6203869c-26e6-46b2-b173-d8a7b16707d3" acquired by "delete_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:05 devstack sudo[101889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f
Jul 07 22:49:05 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[70970a0e-c2ac-4d1c-a44a-54ee82a46f52]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:05 devstack sudo[101891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3
Jul 07 22:49:05 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:06 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.164s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4f8b6db8-3ec6-400a-a18f-3c681eae5ee4 tempest-VolumesGetTest-1025537146 None] Lock "cinder-3997bd8b-872b-446b-ba02-61c396b48bf0-delete_volume" released by "delete_volume" :: held 4.746s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:06 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" returned: 0 in 1.031s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-quobyte-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87" released by "delete_volume" :: held 2.408s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Created reservations ['3627ff9d-623d-49b5-af5f-5c7fef36393a', 'cd05a363-ccf0-47f5-87ac-57a1b151205f', '76eee32d-9699-41e8-b23a-1001ebdbfa44', 'd7aaef39-946b-49b0-8ab8-03e7963140ae'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:06 devstack sudo[101915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:06 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:07 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f" returned: 0 in 1.367s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (3247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.258s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.892s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-434435243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2c8854-ceae-4bc7-9e21-d493bf3012d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:00Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume ce2c8854-ceae-4bc7-9e21-d493bf3012d1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:07 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:07 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3" returned: 0 in 1.361s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:07 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 1073741824
Jul 07 22:49:07 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd941b17-134e-4588-a62d-fc5a86837340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0e479d-5380-44bd-b202-09360da58f6f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be5e80-14c6-45fe-952e-b6b927169229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:07 devstack sudo[101920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3
Jul 07 22:49:07 devstack sudo[101920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:07 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-be0e479d-5380-44bd-b202-09360da58f6f (be0e479d-5380-44bd-b202-09360da58f6f): created successfully
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60be5e80-14c6-45fe-952e-b6b927169229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (b56a5488-99cb-4979-8f9f-673c23297891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-66ab9f21-9e9c-4923-a171-fa2afa27d2f9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:49:07 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.093s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Deleted volume successfully.
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-37d0d635-7d48-43e9-a303-2bc255da02d1 tempest-VolumeDependencyTests-893050123 None] Lock "cinder-b5683414-81d4-4d9e-b5a1-b1d27b1c5d87-delete_volume" released by "delete_volume" :: held 4.036s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:08 devstack sudo[101920]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:08 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6203869c-26e6-46b2-b173-d8a7b16707d3" returned: 0 in 1.169s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 1073741824" returned: 0 in 1.208s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-6203869c-26e6-46b2-b173-d8a7b16707d3" released by "delete_volume" :: held 2.607s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:08 devstack sudo[101930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1
Jul 07 22:49:08 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Created reservations ['defe88f2-5e04-4d97-81a7-0d585d77a87a', '45d44fa9-f908-4ce6-a9cd-8b1eb2e8b244', '1997eac9-0ac7-43ff-b93e-752b8a4788aa', '90f25946-2567-4136-9b05-805724742e2f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:08 devstack sudo[101932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:08 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:09 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" returned: 0 in 0.791s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.846s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-725219043',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70f43c66-f0af-41d9-af80-544cb06c784f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:01Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume 70f43c66-f0af-41d9-af80-544cb06c784f {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:09 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:09 devstack sudo[101936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f 1073741824
Jul 07 22:49:09 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459e1062-33ec-464c-a8d2-6d8048ab20f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ba326c-819b-48a5-9fcc-bf8402486ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 (ce2c8854-ceae-4bc7-9e21-d493bf3012d1): created successfully
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ba326c-819b-48a5-9fcc-bf8402486ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (7db60a31-4781-4832-8d82-5e7d9e211f8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d53caa13-3a06-4ab1-b667-6d364254acec tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:49:09 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.879s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a35e9eeb-bc95-4d30-a2ff-62513fdafd9a tempest-VolumesGetTest-1025537146 None] Lock "cinder-6203869c-26e6-46b2-b173-d8a7b16707d3-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (0d868033-76ee-44d3-a6ee-ab97fab49159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46debdeb-e236-4506-9008-1e4297d36968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46debdeb-e236-4506-9008-1e4297d36968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1661361175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55dfaac-9540-403b-998f-857e9df21c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:10Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3b55ed-b514-48fb-8a37-38c69f7979b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3b55ed-b514-48fb-8a37-38c69f7979b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aacd632-b3be-4653-a4d2-a59149e755d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aacd632-b3be-4653-a4d2-a59149e755d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f55dfaac-9540-403b-998f-857e9df21c40', 'volume_name': 'volume-f55dfaac-9540-403b-998f-857e9df21c40', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101cbbe8-a60b-4b92-92a5-e9c86d2eae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101cbbe8-a60b-4b92-92a5-e9c86d2eae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0759b89-d0c6-491f-ac25-e16168a464cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Volume f55dfaac-9540-403b-998f-857e9df21c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f55dfaac-9540-403b-998f-857e9df21c40', 'volume_size': 1}
Jul 07 22:49:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:10 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f 1073741824" returned: 0 in 1.117s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:10 devstack sudo[101942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f
Jul 07 22:49:10 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:11 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.544s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-996187954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b97d7da-775d-4037-8c04-41e33dda5ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1dcb15f3ad4a41bacbffd467fb91cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:02Z,use_quota=True,user_id='8a8443ef0f98464ab85fb2d8e63d5b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Creating volume 6b97d7da-775d-4037-8c04-41e33dda5ad8 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:11 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:11 devstack sudo[101945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 1073741824
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b5d811-843b-4043-898d-d299e50ff0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70f43c66-f0af-41d9-af80-544cb06c784f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:11 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63db999-c1a5-46bd-9cfa-8fda0b36c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:11 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-70f43c66-f0af-41d9-af80-544cb06c784f (70f43c66-f0af-41d9-af80-544cb06c784f): created successfully
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63db999-c1a5-46bd-9cfa-8fda0b36c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (ddafe6bf-2eb7-4c08-babd-e4bf3d04010b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-56403363-a6eb-4d42-914d-fee93ff33c53 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:49:12 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 1073741824" returned: 0 in 1.066s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:12 devstack sudo[101951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8
Jul 07 22:49:12 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:12 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.049s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1661361175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f55dfaac-9540-403b-998f-857e9df21c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:10Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Creating volume f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:12 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:12 devstack sudo[101957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 1073741824
Jul 07 22:49:12 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39ec0758-a50d-4f4c-9c8e-6b55f02453f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b97d7da-775d-4037-8c04-41e33dda5ad8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3140d99-d853-42a8-a26b-027e1a42ce38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:13 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Volume volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 (6b97d7da-775d-4037-8c04-41e33dda5ad8): created successfully
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3140d99-d853-42a8-a26b-027e1a42ce38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Flow 'volume_create_manager' (550880d9-7e2d-494f-80c4-a9afaccc8c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:13 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f6216460-fb7d-486e-a2c3-7dd12e6c72f4 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created volume successfully.
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-6b97d7da-775d-4037-8c04-41e33dda5ad8-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-6b97d7da-775d-4037-8c04-41e33dda5ad8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-6b97d7da-775d-4037-8c04-41e33dda5ad8" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-6b97d7da-775d-4037-8c04-41e33dda5ad8" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a523c33-430b-4fd0-82f0-fb1f26fa3c65]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:14 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 1073741824" returned: 0 in 1.100s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:14 devstack sudo[101966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:14 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:14 devstack sudo[101965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8
Jul 07 22:49:14 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Flow 'volume_create_manager' (605d9653-6da6-4028-aafe-10472f1162f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099222d2-a122-44e3-bafe-af721951d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099222d2-a122-44e3-bafe-af721951d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc263b02-43f4-460f-a736-6fe9363f64df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632e5826ba6c4805b159eac858ef6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:14Z,use_quota=True,user_id='96827ae921e44f38b630fa1d424b62a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0e228d-abdf-467b-b772-8409e0b1df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0e228d-abdf-467b-b772-8409e0b1df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca2f74-0e8c-47b3-8f89-c9761517b34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faca2f74-0e8c-47b3-8f89-c9761517b34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc263b02-43f4-460f-a736-6fe9363f64df', 'volume_name': 'volume-bc263b02-43f4-460f-a736-6fe9363f64df', 'volume_size': 1, 'image_id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad5ea985e63e4e6c313b03c5b7dfa9bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '632e5826ba6c4805b159eac858ef6d04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45999114bab4fd18904221c20ca58206e05c7e3e1de9bdc81f420698dcd8863c1b14b0b8f2734de11f0e9f58da20e8de39cb22160c715d0e8713c817238bbf44', 'id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55d5017-8f43-40fc-818d-0930db5c8a12/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69ea2570>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76c8fa-e2fe-4f39-86e8-5b28d0cbd5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e76c8fa-e2fe-4f39-86e8-5b28d0cbd5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197e6d53-7103-4796-b4ab-f967568503b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Volume bc263b02-43f4-460f-a736-6fe9363f64df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc263b02-43f4-460f-a736-6fe9363f64df', 'volume_size': 1, 'image_id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad5ea985e63e4e6c313b03c5b7dfa9bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '632e5826ba6c4805b159eac858ef6d04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45999114bab4fd18904221c20ca58206e05c7e3e1de9bdc81f420698dcd8863c1b14b0b8f2734de11f0e9f58da20e8de39cb22160c715d0e8713c817238bbf44', 'id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55d5017-8f43-40fc-818d-0930db5c8a12/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69ea2570>}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Trying to clone bc263b02-43f4-460f-a736-6fe9363f64df from image d55d5017-8f43-40fc-818d-0930db5c8a12 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:49:14 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0759b89-d0c6-491f-ac25-e16168a464cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f55dfaac-9540-403b-998f-857e9df21c40', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0246f1fe-7ccb-4a40-bc73-ebad2a3fabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:14 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Volume volume-f55dfaac-9540-403b-998f-857e9df21c40 (f55dfaac-9540-403b-998f-857e9df21c40): created successfully
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0246f1fe-7ccb-4a40-bc73-ebad2a3fabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (0d868033-76ee-44d3-a6ee-ab97fab49159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4e3a95b5-dfbb-4dda-bdcc-e8d5efe66d5b tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:49:14 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef734b9c-eb2a-431a-94d7-2ed19f565bdf]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:14 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8" returned: 0 in 0.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:15 devstack sudo[101974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8
Jul 07 22:49:15 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:15 devstack sudo[101973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:15 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (fa477892-bdf3-4818-b2eb-b1fad3d1714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec61f4d-81e4-4afa-bb6a-03e3387fbf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cec61f4d-81e4-4afa-bb6a-03e3387fbf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-616389394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84acfbff-5375-4eb3-b052-8402f38ba021,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=f55dfaac-9540-403b-998f-857e9df21c40,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:16Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f1e2a-d934-4be9-9565-66f5644834d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (902f1e2a-d934-4be9-9565-66f5644834d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee565d-0802-4529-9ae8-d8b1369f3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:15 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25ee565d-0802-4529-9ae8-d8b1369f3536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '84acfbff-5375-4eb3-b052-8402f38ba021', 'volume_name': 'volume-84acfbff-5375-4eb3-b052-8402f38ba021', 'volume_size': 1, 'source_volid': 'f55dfaac-9540-403b-998f-857e9df21c40', 'source_volstatus': 'available'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:15 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea81c6-fe65-4cb7-b351-2b93942bde7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cea81c6-fe65-4cb7-b351-2b93942bde7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256e6a4c-4ad4-42ed-bddb-c7f7bff93937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Volume 84acfbff-5375-4eb3-b052-8402f38ba021: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-84acfbff-5375-4eb3-b052-8402f38ba021', 'volume_size': 1, 'source_volid': 'f55dfaac-9540-403b-998f-857e9df21c40', 'source_volstatus': 'available'}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6b97d7da-775d-4037-8c04-41e33dda5ad8" returned: 0 in 0.882s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Cloning volume f55dfaac-9540-403b-998f-857e9df21c40 to volume 84acfbff-5375-4eb3-b052-8402f38ba021
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-6b97d7da-775d-4037-8c04-41e33dda5ad8" released by "delete_volume" :: held 1.937s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Creating offline snapshot 869fce08-cdf5-417f-b85e-441794cbedc3 of volume f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e109b42-e14a-44e8-8c0e-2b716e845faf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:15 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:15 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['7c51583f-0f4a-4d37-8301-f45adca2511a', '26e09b87-7893-42df-a2ac-2b77842abb5a', 'b3d8e4ef-649f-47d1-887a-8847e258786b', 'd6b52282-0e0f-487f-92e8-0f83ae3958ce'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:16 devstack sudo[101982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:16 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack sudo[101984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:16 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-70f43c66-f0af-41d9-af80-544cb06c784f-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-70f43c66-f0af-41d9-af80-544cb06c784f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-70f43c66-f0af-41d9-af80-544cb06c784f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-70f43c66-f0af-41d9-af80-544cb06c784f" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fce30c-ab4b-4aaf-9e35-cca7106a4b0e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:16 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f
Jul 07 22:49:16 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:16 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 1 in 1.064s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Temporary image d55d5017-8f43-40fc-818d-0930db5c8a12 is fetched for user 96827ae921e44f38b630fa1d424b62a7. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:49:16 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.848s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:16 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 0.989s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-95e623b5-562f-4a46-804a-0da244ed3fb9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-6b97d7da-775d-4037-8c04-41e33dda5ad8-delete_volume" released by "delete_volume" :: held 3.130s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:17 devstack sudo[101998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 1G
Jul 07 22:49:17 devstack sudo[101998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[26578543-db59-46a3-98b6-537b0fefff98]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:17 devstack sudo[102000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:17 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:17 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f" returned: 0 in 0.936s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:17 devstack sudo[102005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f
Jul 07 22:49:17 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:18 devstack sudo[101998]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 1G" returned: 0 in 1.089s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55dfaac-9540-403b-998f-857e9df21c40 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:18 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 0 in 1.007s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:18 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55dfaac-9540-403b-998f-857e9df21c40 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:18 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:18 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-70f43c66-f0af-41d9-af80-544cb06c784f" returned: 0 in 0.888s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-70f43c66-f0af-41d9-af80-544cb06c784f" released by "delete_volume" :: held 1.887s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:18 devstack sudo[102015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:18 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['a50cdd88-3ca2-4c73-863a-64316f46d974', 'b1ce9b69-7e13-45f4-ac07-2b4dc4065ec3', '29f33b70-aca4-4b4c-80e9-60ff00944b76', 'edae28b4-65d8-4829-a9fc-b29b54426d3c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:18 devstack sudo[102018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:18 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-ce2c8854-ceae-4bc7-9e21-d493bf3012d1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-ce2c8854-ceae-4bc7-9e21-d493bf3012d1-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6853b3-97ec-43dd-8269-dd2c0242d815]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:19 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1
Jul 07 22:49:19 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:19 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f55dfaac-9540-403b-998f-857e9df21c40 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 1.356s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:19 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 is being set with open permissions: ugo+rw
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:19 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 1 in 1.369s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:19 devstack sudo[102033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:19 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:19 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.977s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9f8f5f6b-d0d9-4251-a760-1499706f7ca9 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-70f43c66-f0af-41d9-af80-544cb06c784f-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:20 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" returned: 0 in 1.185s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:20 devstack sudo[102049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1
Jul 07 22:49:20 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:20 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 0.997s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:20 devstack sudo[102053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info
Jul 07 22:49:20 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:20 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-ce2c8854-ceae-4bc7-9e21-d493bf3012d1" released by "delete_volume" :: held 2.024s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=129,cinder:UPDATE=168,cinder:DELETE=16,cinder:INSERT=39 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:49:20 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['e4a7b5bb-f4ff-4605-a718-df8fc255c447', 'd1a8d9ac-3971-46c3-8064-7fc979a2383b', 'f9bc0b46-223b-4d74-92d9-50c840d55e64', '3cd2c38e-7b44-4396-9c1d-af5c60b29e01'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:21 devstack sudo[102057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:21 devstack sudo[102057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:21 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:21 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info is being set with open permissions: ugo+rw
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:21 devstack sudo[102059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info
Jul 07 22:49:21 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:21 devstack sudo[102057]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-667725d4-9f5b-4b3a-b93f-4f7e1a202744 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-ce2c8854-ceae-4bc7-9e21-d493bf3012d1-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:21 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.info" returned: 0 in 0.654s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] snapshot: 869fce08-cdf5-417f-b85e-441794cbedc3, volume: 84acfbff-5375-4eb3-b052-8402f38ba021,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3b8b0-6f13-4e0f-b309-5d12fb50cf1f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:22 devstack sudo[102063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:22 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-be0e479d-5380-44bd-b202-09360da58f6f-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-be0e479d-5380-44bd-b202-09360da58f6f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-be0e479d-5380-44bd-b202-09360da58f6f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-be0e479d-5380-44bd-b202-09360da58f6f" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1182cf8-f202-4b79-870a-cc51af9b6a3f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:22 devstack sudo[102065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f
Jul 07 22:49:22 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:22 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 0.878s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55dfaac-9540-403b-998f-857e9df21c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1df703e-26ce-4c4c-b645-471007a7b41e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:22 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:22 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:23 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f" returned: 0 in 0.779s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:23 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f
Jul 07 22:49:23 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:23 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 0.814s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:23 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021
Jul 07 22:49:23 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:23 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0e479d-5380-44bd-b202-09360da58f6f" returned: 0 in 0.832s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-be0e479d-5380-44bd-b202-09360da58f6f" released by "delete_volume" :: held 1.678s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['7817805d-a1e8-473b-b108-9ba699e77f45', '6ef03a30-0666-498c-8058-0872ac1183d8', 'ef0e622e-f9c0-4bd6-98fc-2779cd571ca4', 'aa05f14e-e2e7-4d2e-b8f9-0936921dbed1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:24 devstack sudo[102118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:24 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-13e2dc63-a0f7-4364-aebc-4402a5d7d614-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-13e2dc63-a0f7-4364-aebc-4402a5d7d614-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-13e2dc63-a0f7-4364-aebc-4402a5d7d614" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-13e2dc63-a0f7-4364-aebc-4402a5d7d614" acquired by "delete_volume" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814f9a7-9110-47c9-89be-c2af4482d0f2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:24 devstack sudo[102135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614
Jul 07 22:49:24 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:25 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.056s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:25 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e9d16bf-ef7b-472a-8891-054df55d9833 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-be0e479d-5380-44bd-b202-09360da58f6f-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:25 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614" returned: 0 in 1.254s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:26 devstack sudo[102170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614
Jul 07 22:49:26 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:28 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-13e2dc63-a0f7-4364-aebc-4402a5d7d614" returned: 0 in 2.557s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-13e2dc63-a0f7-4364-aebc-4402a5d7d614" released by "delete_volume" :: held 3.926s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:28 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['119301e8-aae8-4c63-ab67-462124683f93', '0a2a896d-fbed-4c93-a353-935d02fe1905', '6cd65ace-1dee-4243-835a-363cba4c8210', '3cbeb07f-64a8-4a49-aeb9-45cc01b2db5c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:29 devstack sudo[102175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:29 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-395c73f3-2dd6-48f4-9eec-2b768f8be483-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-395c73f3-2dd6-48f4-9eec-2b768f8be483-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "cinder-quobyte-395c73f3-2dd6-48f4-9eec-2b768f8be483" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-395c73f3-2dd6-48f4-9eec-2b768f8be483" acquired by "delete_volume" :: waited 0.053s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409ab1f-c723-4d90-a1f9-ee8c5ca2e0c5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:30 devstack sudo[102177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483
Jul 07 22:49:30 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:31 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021" returned: 0 in 7.543s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fab929f-56ce-4b9b-b8a7-cbbc5989d152]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:31 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483" returned: 0 in 1.397s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:31 devstack sudo[102182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:31 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:31 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.180s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:31 devstack sudo[102185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483
Jul 07 22:49:31 devstack sudo[102185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fc21ea1d-11a8-4c66-8ffd-dc4f1afd453a tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" by "attach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fc21ea1d-11a8-4c66-8ffd-dc4f1afd453a tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" acquired by "attach_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c89c620f-f34e-42cf-a181-83c78fb87d10 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-13e2dc63-a0f7-4364-aebc-4402a5d7d614-delete_volume" released by "delete_volume" :: held 6.902s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fc21ea1d-11a8-4c66-8ffd-dc4f1afd453a tempest-VolumesActionsTest-1513216216 None] Attaching volume f3aeb803-8cce-45cf-81cf-bb077924bfd6 to instance b9707e0e-8c3e-494e-9cea-39c1b8a5685b at mountpoint /dev/vdb on host None.
Jul 07 22:49:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fc21ea1d-11a8-4c66-8ffd-dc4f1afd453a tempest-VolumesActionsTest-1513216216 None] Attach volume completed successfully.
Jul 07 22:49:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fc21ea1d-11a8-4c66-8ffd-dc4f1afd453a tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6" released by "attach_volume" :: held 0.123s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a9efbb2-d109-446a-b8e1-ac066e67af49 tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" by "detach_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a9efbb2-d109-446a-b8e1-ac066e67af49 tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2a9efbb2-d109-446a-b8e1-ac066e67af49 tempest-VolumesActionsTest-1513216216 None] Detaching volume f3aeb803-8cce-45cf-81cf-bb077924bfd6 from instance b9707e0e-8c3e-494e-9cea-39c1b8a5685b.
Jul 07 22:49:32 devstack sudo[102185]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2a9efbb2-d109-446a-b8e1-ac066e67af49 tempest-VolumesActionsTest-1513216216 None] Detach volume completed successfully.
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-395c73f3-2dd6-48f4-9eec-2b768f8be483" returned: 0 in 0.883s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a9efbb2-d109-446a-b8e1-ac066e67af49 tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-detach_volume" released by "detach_volume" :: held 0.079s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-quobyte-395c73f3-2dd6-48f4-9eec-2b768f8be483" released by "delete_volume" :: held 2.408s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Created reservations ['f8616610-aef9-478e-88fa-89471bfd0bce', '38679e30-cd10-4558-a9b2-5c433b029d7f', 'b5cb6743-426d-425c-89f9-ab2f4af3aa03', 'b7760090-feab-4655-a0e4-adec124c14fb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:32 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 1.162s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40, size 1024.00 MB, duration 7.54 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:49:32 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Converted 1024.00 MB image at 135.73 MB/s
Jul 07 22:49:32 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 is being set with open permissions: ugo+rw
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:32 devstack sudo[102192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021
Jul 07 22:49:32 devstack sudo[102192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:32 devstack sudo[102194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:32 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:33 devstack sudo[102192]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:33 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.763s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" released by "_copy_volume_from_snapshot" :: held 11.282s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:33 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Deleted volume successfully.
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-869fce08-cdf5-417f-b85e-441794cbedc3" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6141638e-865e-4bbc-83b2-c2cf81248f98 tempest-CreateVolumesFromSourceVolumeTest-1104461457 None] Lock "cinder-395c73f3-2dd6-48f4-9eec-2b768f8be483-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-869fce08-cdf5-417f-b85e-441794cbedc3" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Deleting offline snapshot 869fce08-cdf5-417f-b85e-441794cbedc3 of volume f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] snapshot_file for this snap is: volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c40907b-55e8-4b30-b471-d5946910ea04]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:33 devstack sudo[102198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:33 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:33 devstack sudo[102200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:33 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:34 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 1.089s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f55dfaac-9540-403b-998f-857e9df21c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:49:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b0df5e-11df-4bae-ae12-21f20c8f7fef]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:34 devstack sudo[102211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:34 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:35 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.291s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:49:35 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 1.324s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:35 devstack sudo[102235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:35 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:36 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 0.939s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:36 devstack sudo[102245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3
Jul 07 22:49:36 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:37 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40.869fce08-cdf5-417f-b85e-441794cbedc3" returned: 0 in 0.740s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-869fce08-cdf5-417f-b85e-441794cbedc3" released by "_delete_snapshot" :: held 4.222s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.641s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.077s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc263b02-43f4-460f-a736-6fe9363f64df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='632e5826ba6c4805b159eac858ef6d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:14Z,use_quota=True,user_id='96827ae921e44f38b630fa1d424b62a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Creating volume bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:37 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:37 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1073741824
Jul 07 22:49:37 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (256e6a4c-4ad4-42ed-bddb-c7f7bff93937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84acfbff-5375-4eb3-b052-8402f38ba021', 'volume_size': 1, 'source_volid': 'f55dfaac-9540-403b-998f-857e9df21c40', 'source_volstatus': 'available'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4a2428-2288-49b9-b9ac-54139dcc2819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Volume volume-84acfbff-5375-4eb3-b052-8402f38ba021 (84acfbff-5375-4eb3-b052-8402f38ba021): created successfully
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d4a2428-2288-49b9-b9ac-54139dcc2819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (fa477892-bdf3-4818-b2eb-b1fad3d1714b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-50686cb0-55c5-45e7-9b23-e22af8089a47 tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:49:38 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1073741824" returned: 0 in 1.133s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:38 devstack sudo[102260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:38 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (6154e8ca-3ff2-4e0c-b4ed-40ebbbe6fceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad0784-2e7e-47ea-8e87-d1c4e7a3c9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad0784-2e7e-47ea-8e87-d1c4e7a3c9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642675369',display_name='tempest-VolumesGetTest-Volume-1239445448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54b1f94-82bb-4179-986e-621ba31d022a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:39Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce9a8cc-46e8-49f8-8fae-c29a346a1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cce9a8cc-46e8-49f8-8fae-c29a346a1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed498a2-2b7b-4040-95cd-91fa912c22f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:39 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed498a2-2b7b-4040-95cd-91fa912c22f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b54b1f94-82bb-4179-986e-621ba31d022a', 'volume_name': 'volume-b54b1f94-82bb-4179-986e-621ba31d022a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f56ddc-6431-48e1-a8f2-324af8131a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f56ddc-6431-48e1-a8f2-324af8131a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218cbd4f-2f3d-4e4d-926a-7ea10c8144e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Volume b54b1f94-82bb-4179-986e-621ba31d022a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b54b1f94-82bb-4179-986e-621ba31d022a', 'volume_size': 1}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 0 in 0.881s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1642675369',display_name='tempest-VolumesGetTest-Volume-1239445448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b54b1f94-82bb-4179-986e-621ba31d022a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:39Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Creating volume b54b1f94-82bb-4179-986e-621ba31d022a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:49:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:39 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a 1073741824
Jul 07 22:49:39 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Attempting download of d55d5017-8f43-40fc-818d-0930db5c8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}])) to volume bc263b02-43f4-460f-a736-6fe9363f64df. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0d67da-9cd5-47ca-b9a8-4f1cd7b302ca]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:39 devstack sudo[102265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam
Jul 07 22:49:39 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:40 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a 1073741824" returned: 0 in 1.001s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:40 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam" returned: 0 in 0.903s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:40 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a
Jul 07 22:49:40 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:40 devstack sudo[102273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam
Jul 07 22:49:40 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:41 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a" returned: 0 in 0.849s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] <== create_volume: return (1943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218cbd4f-2f3d-4e4d-926a-7ea10c8144e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b54b1f94-82bb-4179-986e-621ba31d022a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dc789e-4d1a-49c6-8d18-5d58207346e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Volume volume-b54b1f94-82bb-4179-986e-621ba31d022a (b54b1f94-82bb-4179-986e-621ba31d022a): created successfully
Jul 07 22:49:41 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60dc789e-4d1a-49c6-8d18-5d58207346e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (6154e8ca-3ff2-4e0c-b4ed-40ebbbe6fceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam" returned: 1 in 0.968s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d55d5017-8f43-40fc-818d-0930db5c8a12_yihyqeam' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3588953-50f7-4e7f-b4ab-40f5e1904b10]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a563d063-6fe6-4dd6-a986-31ee54682fca tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:49:41 devstack sudo[102280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:41 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:42 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 0 in 0.816s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:42 devstack sudo[102284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD
Jul 07 22:49:42 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[025ce50e-acc5-49cd-a2b2-be935919a39d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-b54b1f94-82bb-4179-986e-621ba31d022a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:42 devstack sudo[102286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:49:42 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "cinder-b54b1f94-82bb-4179-986e-621ba31d022a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-b54b1f94-82bb-4179-986e-621ba31d022a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-b54b1f94-82bb-4179-986e-621ba31d022a" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90ddd47-b243-449a-a905-aa83147bcce3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:43 devstack sudo[102288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a
Jul 07 22:49:43 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:43 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD" returned: 1 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] d55d5017-8f43-40fc-818d-0930db5c8a12 was raw, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:43 devstack sudo[102293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:43 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:43 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.858s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[592728ac-7ee3-435d-a36d-1e9de8854f0f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:43 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:49:43 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:43 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a" returned: 0 in 0.895s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:43 devstack sudo[102303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a
Jul 07 22:49:43 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:44 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 0 in 0.866s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d55d5017-8f43-40fc-818d-0930db5c8a12_6j6_wzf8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:49:44 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:44 devstack sudo[102308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1G
Jul 07 22:49:44 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:44 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.845s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.ae49487d-d77f-4026-a2c1-45ad96f2b0caj4se3xc3.img {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:44 devstack sudo[102314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.ae49487d-d77f-4026-a2c1-45ad96f2b0caj4se3xc3.img
Jul 07 22:49:44 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:44 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b54b1f94-82bb-4179-986e-621ba31d022a" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-b54b1f94-82bb-4179-986e-621ba31d022a" released by "delete_volume" :: held 1.722s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Created reservations ['2953c133-09f4-4376-8890-0ecdb2697507', 'cd3cfef8-2244-4cce-8747-d5c70b0af2be', 'cce41dc6-9bc5-4789-81b7-45f06810a4b6', 'cfc46bea-5d92-431d-80a8-c507764d4f45'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:44 devstack sudo[102320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:44 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:45 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df 1G" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c464ff-0c77-41f7-bf14-95fc8d2061a6]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:45 devstack sudo[102324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:45 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-84acfbff-5375-4eb3-b052-8402f38ba021-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "cinder-84acfbff-5375-4eb3-b052-8402f38ba021-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" acquired by "delete_volume" :: waited 0.074s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4498e3-8399-4d8f-b3ea-a942a080639e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:45 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.959s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:49:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-077d2644-7d85-443b-8dd8-57d2ecfc6080 tempest-VolumesGetTest-1025537146 None] Lock "cinder-b54b1f94-82bb-4179-986e-621ba31d022a-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:45 devstack sudo[102335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021
Jul 07 22:49:45 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:47 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 0 in 2.126s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:47 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021" returned: 0 in 1.645s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:47 devstack sudo[102344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021
Jul 07 22:49:47 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:47 devstack sudo[102343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:47 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:48 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-84acfbff-5375-4eb3-b052-8402f38ba021" returned: 0 in 1.638s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-84acfbff-5375-4eb3-b052-8402f38ba021" released by "delete_volume" :: held 3.431s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:49 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 1 in 1.800s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Downloaded image d55d5017-8f43-40fc-818d-0930db5c8a12 ((None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}])) to volume bc263b02-43f4-460f-a736-6fe9363f64df successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Temporary image d55d5017-8f43-40fc-818d-0930db5c8a12 for user 96827ae921e44f38b630fa1d424b62a7 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Marking volume bc263b02-43f4-460f-a736-6fe9363f64df as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Copying metadata from image d55d5017-8f43-40fc-818d-0930db5c8a12 to bc263b02-43f4-460f-a736-6fe9363f64df. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Creating volume glance metadata for volume bc263b02-43f4-460f-a736-6fe9363f64df backed by image d55d5017-8f43-40fc-818d-0930db5c8a12 with: {'image_id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ad5ea985e63e4e6c313b03c5b7dfa9bd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Created reservations ['7396116c-b7b0-4453-acd8-9d43af759cb5', 'fc4dfcc7-10ac-4c38-a2e4-402ed2c38d95', 'adbbb920-94e9-4603-a5da-d44145994c65', '8ecf6896-0ab2-40bc-acb6-74eda1d92f15'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197e6d53-7103-4796-b4ab-f967568503b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc263b02-43f4-460f-a736-6fe9363f64df', 'volume_size': 1, 'image_id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d55d5017-8f43-40fc-818d-0930db5c8a12', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ad5ea985e63e4e6c313b03c5b7dfa9bd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '632e5826ba6c4805b159eac858ef6d04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '45999114bab4fd18904221c20ca58206e05c7e3e1de9bdc81f420698dcd8863c1b14b0b8f2734de11f0e9f58da20e8de39cb22160c715d0e8713c817238bbf44', 'id': 'd55d5017-8f43-40fc-818d-0930db5c8a12', 'created_at': datetime.datetime(2026, 7, 7, 20, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d55d5017-8f43-40fc-818d-0930db5c8a12/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69ea2570>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6857c37-d69a-4804-9c59-b74b54d7c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Volume volume-bc263b02-43f4-460f-a736-6fe9363f64df (bc263b02-43f4-460f-a736-6fe9363f64df): created successfully
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6857c37-d69a-4804-9c59-b74b54d7c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Flow 'volume_create_manager' (605d9653-6da6-4028-aafe-10472f1162f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5fc336ad-e14a-4e45-9f2e-3b7f91edb811 tempest-VolumeImageDependencyTests-1674792025 None] Created volume successfully.
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:49 devstack sudo[102352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:49 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Acquiring lock "cinder-bc263b02-43f4-460f-a736-6fe9363f64df-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "cinder-bc263b02-43f4-460f-a736-6fe9363f64df-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Acquiring lock "cinder-quobyte-bc263b02-43f4-460f-a736-6fe9363f64df" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "cinder-quobyte-bc263b02-43f4-460f-a736-6fe9363f64df" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[14339c5f-7b2c-4955-a0a5-1807236da1eb]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:50 devstack sudo[102354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:50 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-f55dfaac-9540-403b-998f-857e9df21c40-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "cinder-f55dfaac-9540-403b-998f-857e9df21c40-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:50 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.ae49487d-d77f-4026-a2c1-45ad96f2b0caj4se3xc3.img" returned: 0 in 6.141s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06d2bd9-e6b6-40e0-976f-0bd38d980997]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:50 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.142s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-f55dfaac-9540-403b-998f-857e9df21c40" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:49:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-f55dfaac-9540-403b-998f-857e9df21c40" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5c58cd47-e2aa-4eae-b605-06a65fdf5e84 tempest-VolumesGetTest-1025537146 None] Lock "cinder-84acfbff-5375-4eb3-b052-8402f38ba021-delete_volume" released by "delete_volume" :: held 5.352s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6d4031-de05-4f72-8856-03b4e8cf86e4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:50 devstack sudo[102357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:49:50 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:50 devstack sudo[102358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:50 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:51 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 0 in 0.974s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:51 devstack sudo[102363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:51 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:51 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:51 devstack sudo[102371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40
Jul 07 22:49:51 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:51 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 1.001s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.ae49487d-d77f-4026-a2c1-45ad96f2b0caj4se3xc3.img {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:49:51 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Converted 1024.00 MB image at 166.72 MB/s
Jul 07 22:49:51 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] ae49487d-d77f-4026-a2c1-45ad96f2b0ca was raw, no need to convert to raw {{(pid=88152) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 07 22:49:52 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 1 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:52 devstack sudo[102376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df
Jul 07 22:49:52 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:52 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f55dfaac-9540-403b-998f-857e9df21c40" returned: 0 in 0.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-f55dfaac-9540-403b-998f-857e9df21c40" released by "delete_volume" :: held 1.627s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Created reservations ['e294518a-cca6-425d-a820-d11ee32b355c', '86ccca84-de90-4bf1-9e5c-8b94cda2eb9d', '7629a833-ff2d-401d-8c98-40b5c26a32f2', '5341c014-903c-4732-a53b-725ce9a1fe03'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:52 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:52 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:52 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-bc263b02-43f4-460f-a736-6fe9363f64df" returned: 0 in 0.695s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "cinder-quobyte-bc263b02-43f4-460f-a736-6fe9363f64df" released by "delete_volume" :: held 2.644s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Created reservations ['a6d31660-ec3e-4368-8d45-97bf4aca935a', '42e14ff6-73a4-4428-939d-bb421fba4eda', '1f218519-654a-4ef6-bed0-d055f3fb24e2', 'b1cbd5cc-5228-4689-98d3-eef7d934c03e'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:49:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:53 devstack sudo[102382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:49:53 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:53 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3bdc2b0b-c583-4c08-bda6-4f7c295689b1 tempest-VolumesGetTest-1025537146 None] Lock "cinder-f55dfaac-9540-403b-998f-857e9df21c40-delete_volume" released by "delete_volume" :: held 2.703s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:53 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:49:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Deleted volume successfully.
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6c5e0ffa-8225-4ae0-be32-6eabc7619907 tempest-VolumeImageDependencyTests-1674792025 None] Lock "cinder-bc263b02-43f4-460f-a736-6fe9363f64df-delete_volume" released by "delete_volume" :: held 3.820s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:49:53 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (3fed75a9-b96b-4bfb-8cbe-f997001d74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95541936-4b04-453b-8bf0-2daa6d93dc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95541936-4b04-453b-8bf0-2daa6d93dc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1461233083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f59af9-41fa-4171-98dc-9e6c38974fd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:54Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2460f5c-98cc-47af-95b2-103e590334d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2460f5c-98cc-47af-95b2-103e590334d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cb1431-f25d-4d58-a98b-e3406dd76b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7cb1431-f25d-4d58-a98b-e3406dd76b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '06f59af9-41fa-4171-98dc-9e6c38974fd5', 'volume_name': 'volume-06f59af9-41fa-4171-98dc-9e6c38974fd5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7445fe90>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8319e0-a4a3-4877-8cb6-62394e8d9724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8319e0-a4a3-4877-8cb6-62394e8d9724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a44c0f-c9ce-4f9a-8897-6bbe5d7e0d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Volume 06f59af9-41fa-4171-98dc-9e6c38974fd5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-06f59af9-41fa-4171-98dc-9e6c38974fd5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7445fe90>}
Jul 07 22:49:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Trying to clone 06f59af9-41fa-4171-98dc-9e6c38974fd5 from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:49:55 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:49:55 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Image download 20.69 MB at 20.69 MB/s
Jul 07 22:49:55 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7508376d-7e15-44ba-887e-e926b025426b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:55 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD
Jul 07 22:49:55 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:56 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD" returned: 0 in 0.874s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:56 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a is fetched for user e51755eae106451a9632d6af254dd363. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:49:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[72147fc1-4213-4319-b318-8291e136ae8f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:49:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:49:56 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD
Jul 07 22:49:56 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:49:57 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Jul 07 22:49:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:49:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Flow 'volume_create_manager' (c33e9e44-a17f-46eb-9410-efc8a0a55a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73d874-23b9-47f2-8fb6-82638fda713b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef73d874-23b9-47f2-8fb6-82638fda713b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309015189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9733ec88-5db0-4824-b3fd-c789511d129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9c936587844a86bcd99ada75ba23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:58Z,use_quota=True,user_id='df3241f18d7c4e14a8eeeb097333b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97af9a8f-78e1-4149-8aea-7b6dfb729e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97af9a8f-78e1-4149-8aea-7b6dfb729e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba3838-bfeb-444d-9c85-67c752314c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ba3838-bfeb-444d-9c85-67c752314c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9733ec88-5db0-4824-b3fd-c789511d129b', 'volume_name': 'volume-9733ec88-5db0-4824-b3fd-c789511d129b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9a2856-3e0a-47c5-8a25-612f888a30c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9a2856-3e0a-47c5-8a25-612f888a30c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99e8e5e-4c92-40fc-970e-2056984c1748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:49:58 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Volume 9733ec88-5db0-4824-b3fd-c789511d129b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9733ec88-5db0-4824-b3fd-c789511d129b', 'volume_size': 1}
Jul 07 22:49:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=95,cinder:INSERT=40,cinder:UPDATE=138,cinder:DELETE=11 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:50:08 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:INSERT=20,cinder:UPDATE=76,cinder:SELECT=57,cinder:DELETE=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.382s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Uploaded volume to glance image-id: ae49487d-d77f-4026-a2c1-45ad96f2b0ca. {{(pid=88152) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.118s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1461233083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f59af9-41fa-4171-98dc-9e6c38974fd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:54Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Creating volume 06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:12 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bf7455d0-14db-4233-99d8-5a077a7a3f60 tempest-VolumesActionsTest-1513216216 None] Copy volume to image completed successfully.
Jul 07 22:50:12 devstack sudo[102445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1073741824
Jul 07 22:50:12 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:12 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1073741824" returned: 0 in 0.833s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:13 devstack sudo[102451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:13 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:13 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 0 in 0.731s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.318s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-309015189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9733ec88-5db0-4824-b3fd-c789511d129b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9c936587844a86bcd99ada75ba23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:49:58Z,use_quota=True,user_id='df3241f18d7c4e14a8eeeb097333b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Creating volume 9733ec88-5db0-4824-b3fd-c789511d129b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:13 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:13 devstack sudo[102454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b 1073741824
Jul 07 22:50:13 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Attempting download of 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 06f59af9-41fa-4171-98dc-9e6c38974fd5. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d8a24e-9faf-48ff-bcde-27f8af0f3be6]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:13 devstack sudo[102456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab
Jul 07 22:50:13 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:14 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b 1073741824" returned: 0 in 0.971s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:14 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab" returned: 0 in 0.872s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:14 devstack sudo[102465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b
Jul 07 22:50:14 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:14 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab
Jul 07 22:50:14 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:15 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b" returned: 0 in 0.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.274s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f99e8e5e-4c92-40fc-970e-2056984c1748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9733ec88-5db0-4824-b3fd-c789511d129b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743c9d0e-96df-4b4e-8c7e-cbbc41bdd697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:15 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677715f-1fe0-44cd-bbf9-68aa33a6f883]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab" returned: 1 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_qpi7myab' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda1ff28-f3d3-4087-8662-541315b687ba]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Volume volume-9733ec88-5db0-4824-b3fd-c789511d129b (9733ec88-5db0-4824-b3fd-c789511d129b): created successfully
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743c9d0e-96df-4b4e-8c7e-cbbc41bdd697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Flow 'volume_create_manager' (c33e9e44-a17f-46eb-9410-efc8a0a55a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-77b9028b-2be0-4ba1-8c96-08ea8a24823f tempest-ProjectReaderTests-680296209 None] Created volume successfully.
Jul 07 22:50:15 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:50:15 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:15 devstack sudo[102472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD
Jul 07 22:50:15 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:16 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD" returned: 0 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] 3d79ec3d-7feb-4185-b960-5d4caffe8b9a was qcow2, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:16 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:16 devstack sudo[102482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:16 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3884f7a5-fe1f-4595-a600-dd3db31bd800]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:16 devstack sudo[102484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:50:16 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Acquiring lock "cinder-9733ec88-5db0-4824-b3fd-c789511d129b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "cinder-9733ec88-5db0-4824-b3fd-c789511d129b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Acquiring lock "cinder-quobyte-9733ec88-5db0-4824-b3fd-c789511d129b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "cinder-quobyte-9733ec88-5db0-4824-b3fd-c789511d129b" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da1f44-dcf4-4b96-815e-479b0bfaf7ab]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:17 devstack sudo[102489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b
Jul 07 22:50:17 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:17 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.929s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:17 devstack sudo[102505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img
Jul 07 22:50:17 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:17 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b" returned: 0 in 0.942s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:17 devstack sudo[102514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b
Jul 07 22:50:17 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:19 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9733ec88-5db0-4824-b3fd-c789511d129b" returned: 0 in 1.188s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "cinder-quobyte-9733ec88-5db0-4824-b3fd-c789511d129b" released by "delete_volume" :: held 2.206s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:19 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 0 in 2.877s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d79ec3d-7feb-4185-b960-5d4caffe8b9a_s8fh0nq3devstack@QuobyteHD, size 112.00 MB, duration 2.88 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:50:19 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Converted 112.00 MB image at 38.92 MB/s
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:19 devstack sudo[102525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1G
Jul 07 22:50:19 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Created reservations ['73dc4326-b38f-4bb2-9383-8bbea6635080', '7d3d0d49-40ee-4fb0-842d-5cf9b227ed87', '70150260-bfb9-4c67-83db-9def26f0a9f4', 'e8d826cb-f735-4c31-8f8c-0757e6e0f9be'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:19 devstack sudo[102527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:19 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:20 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.319s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:20 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Deleted volume successfully.
Jul 07 22:50:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8c5842ac-2dd7-4577-ab09-a886fd24b202 tempest-ProjectReaderTests-680296209 None] Lock "cinder-9733ec88-5db0-4824-b3fd-c789511d129b-delete_volume" released by "delete_volume" :: held 4.099s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:21 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 1G" returned: 0 in 1.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[53509dbe-5671-4171-9984-2e00b8fccceb]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:21 devstack sudo[102533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:21 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Flow 'volume_create_manager' (9dbac485-822a-43d5-8483-39d1be7c4bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54a6f15-cba9-4f80-a7a6-0fc4ffa383c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d54a6f15-cba9-4f80-a7a6-0fc4ffa383c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695648825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef579839-cfbc-4d76-a1d7-7f2918bd806e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9c936587844a86bcd99ada75ba23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:22Z,use_quota=True,user_id='df3241f18d7c4e14a8eeeb097333b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08903520-2e1d-4b8f-a948-50f725ec7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08903520-2e1d-4b8f-a948-50f725ec7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b9c20e-d199-4812-8841-5cc454967756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b9c20e-d199-4812-8841-5cc454967756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef579839-cfbc-4d76-a1d7-7f2918bd806e', 'volume_name': 'volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fdecc4-6fa6-4d1e-b94a-6da37b86aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fdecc4-6fa6-4d1e-b94a-6da37b86aecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97602e2-c2cf-4537-88b3-5cce432677ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Volume ef579839-cfbc-4d76-a1d7-7f2918bd806e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e', 'volume_size': 1}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:22 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img" returned: 0 in 5.435s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2866db58-86a7-4cb1-aec5-1f58c0e32f17]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:22 devstack sudo[102535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:50:22 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:22 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 0 in 1.582s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:23 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:23 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:23 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 1 in 0.837s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Downloaded image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a ((None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}])) to volume 06f59af9-41fa-4171-98dc-9e6c38974fd5 successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Temporary image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a for user e51755eae106451a9632d6af254dd363 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Marking volume 06f59af9-41fa-4171-98dc-9e6c38974fd5 as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:50:23 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 1.006s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6, size 1024.00 MB, duration 5.44 sec, destination /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:50:23 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Converted 1024.00 MB image at 188.37 MB/s
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Copying metadata from image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a to 06f59af9-41fa-4171-98dc-9e6c38974fd5. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Creating volume glance metadata for volume 06f59af9-41fa-4171-98dc-9e6c38974fd5 backed by image 3d79ec3d-7feb-4185-b960-5d4caffe8b9a with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] 687a58bc-c084-484a-be4e-c0c210744e28 was raw, converting to qcow2 {{(pid=88152) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aadd292-941f-4396-b76f-ecd88c730384]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72a44c0f-c9ce-4f9a-8897-6bbe5d7e0d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f59af9-41fa-4171-98dc-9e6c38974fd5', 'volume_size': 1, 'image_id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6797e0b9c33a410d8ea7c09b3260d4d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d79ec3d-7feb-4185-b960-5d4caffe8b9a', 'created_at': datetime.datetime(2026, 7, 7, 20, 27, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 28, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d79ec3d-7feb-4185-b960-5d4caffe8b9a/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7445fe90>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec105c0-74b5-4b16-90f7-2bd0277d6ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Volume volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 (06f59af9-41fa-4171-98dc-9e6c38974fd5): created successfully
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cec105c0-74b5-4b16-90f7-2bd0277d6ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (3fed75a9-b96b-4bfb-8cbe-f997001d74b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:23 devstack sudo[102547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img
Jul 07 22:50:23 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f3f0c75a-5b22-48e6-8de1-f60c9c62e577 tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:50:24 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img" returned: 0 in 0.776s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:24 devstack sudo[102551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img
Jul 07 22:50:24 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:25 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (866871bd-e585-4085-9bda-57c2608d7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d884710-275f-40c3-ad6a-a91ad738aae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img" returned: 1 in 0.845s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img /opt/stack/data/cinder/conversion/vol_upload_q293ped5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:25 devstack sudo[102556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img /opt/stack/data/cinder/conversion/vol_upload_q293ped5
Jul 07 22:50:25 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d884710-275f-40c3-ad6a-a91ad738aae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884064336',display_name='tempest-VolumesGetTest-Volume-1826038448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fd0be6-fd52-4a9b-b837-d3f5377c5d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:25Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9484796-056a-415e-a535-fdce97f9e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9484796-056a-415e-a535-fdce97f9e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d833124b-c94c-4f5b-b777-313181e37d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d833124b-c94c-4f5b-b777-313181e37d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26fd0be6-fd52-4a9b-b837-d3f5377c5d0b', 'volume_name': 'volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272a51eb-52bf-4030-aaa5-df13025dd7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272a51eb-52bf-4030-aaa5-df13025dd7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1dcd42-5fae-4f80-9528-7d671624ca86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Volume 26fd0be6-fd52-4a9b-b837-d3f5377c5d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b', 'volume_size': 1}
Jul 07 22:50:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:26 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img /opt/stack/data/cinder/conversion/vol_upload_q293ped5" returned: 0 in 1.255s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:26 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Image conversion details: src /opt/stack/data/cinder/conversion/f3aeb803-8cce-45cf-81cf-bb077924bfd6.temp_image.687a58bc-c084-484a-be4e-c0c210744e28o8k16ld9.img, size 1024.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/conversion/vol_upload_q293ped5 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:50:26 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Converted 1024.00 MB image at 815.40 MB/s
Jul 07 22:50:26 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c84a7ae-3862-4a93-a28d-72e0cd582e2d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q293ped5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:26 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q293ped5
Jul 07 22:50:26 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:27 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_q293ped5" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.348s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Uploaded volume to glance image-id: 687a58bc-c084-484a-be4e-c0c210744e28. {{(pid=88152) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.655s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695648825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef579839-cfbc-4d76-a1d7-7f2918bd806e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a9c936587844a86bcd99ada75ba23e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:22Z,use_quota=True,user_id='df3241f18d7c4e14a8eeeb097333b48a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Creating volume ef579839-cfbc-4d76-a1d7-7f2918bd806e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:28 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:28 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e 1073741824
Jul 07 22:50:28 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7dd3ae42-62df-4416-994f-2cda1c65d676 tempest-VolumesActionsTest-1513216216 None] Copy volume to image completed successfully.
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "cinder-quobyte-f3aeb803-8cce-45cf-81cf-bb077924bfd6" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-quobyte-f3aeb803-8cce-45cf-81cf-bb077924bfd6" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[264e6437-2cb1-4bfe-9aec-7122295d4ce8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:29 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e 1073741824" returned: 0 in 1.015s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:29 devstack sudo[102575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e
Jul 07 22:50:29 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:29 devstack sudo[102574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:50:29 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:30 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.080s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:25Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-884064336',display_name='tempest-VolumesGetTest-Volume-1826038448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26fd0be6-fd52-4a9b-b837-d3f5377c5d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1695bec5b1a44c187f552b1514c6775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:25Z,use_quota=True,user_id='e51755eae106451a9632d6af254dd363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Creating volume 26fd0be6-fd52-4a9b-b837-d3f5377c5d0b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:30 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:30 devstack sudo[102583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b 1073741824
Jul 07 22:50:30 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97602e2-c2cf-4537-88b3-5cce432677ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14093688-499e-4525-9d2b-1b549e426b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Volume volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e (ef579839-cfbc-4d76-a1d7-7f2918bd806e): created successfully
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14093688-499e-4525-9d2b-1b549e426b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Flow 'volume_create_manager' (9dbac485-822a-43d5-8483-39d1be7c4bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:30 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.833s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-36bc4c5c-cfdd-4e2b-aecf-7a2df8198ee6 tempest-ProjectReaderTests-680296209 None] Created volume successfully.
Jul 07 22:50:30 devstack sudo[102585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6
Jul 07 22:50:30 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:31 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f3aeb803-8cce-45cf-81cf-bb077924bfd6" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-quobyte-f3aeb803-8cce-45cf-81cf-bb077924bfd6" released by "delete_volume" :: held 1.556s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Acquiring lock "cinder-ef579839-cfbc-4d76-a1d7-7f2918bd806e-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "cinder-ef579839-cfbc-4d76-a1d7-7f2918bd806e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Acquiring lock "cinder-quobyte-ef579839-cfbc-4d76-a1d7-7f2918bd806e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "cinder-quobyte-ef579839-cfbc-4d76-a1d7-7f2918bd806e" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Created reservations ['192c75dd-361f-4a34-a262-6be902bbe8f1', 'e35d4cde-842d-4b89-86ec-8366adc92a48', 'fac8ecb7-d385-4f27-a41d-ae8e932423ad', 'e2101898-f441-40af-9f97-4f5549835355'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f5f69c-a625-407b-b7ec-576f37c7350e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:31 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b 1073741824" returned: 0 in 1.039s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:31 devstack sudo[102591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e
Jul 07 22:50:31 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:31 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:31 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:31 devstack sudo[102595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b
Jul 07 22:50:31 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:32 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.742s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Deleted volume successfully.
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3cd72a9b-fe8d-4ee3-aec0-8dcf48edd07f tempest-VolumesActionsTest-1513216216 None] Lock "cinder-f3aeb803-8cce-45cf-81cf-bb077924bfd6-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:32 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" returned: 0 in 0.736s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1dcd42-5fae-4f80-9528-7d671624ca86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26679369-7137-4758-bc72-da621ea16c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:32 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e" returned: 0 in 0.926s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:32 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Volume volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b (26fd0be6-fd52-4a9b-b837-d3f5377c5d0b): created successfully
Jul 07 22:50:32 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e
Jul 07 22:50:32 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26679369-7137-4758-bc72-da621ea16c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:32 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Flow 'volume_create_manager' (866871bd-e585-4085-9bda-57c2608d7be8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9cab32a6-a620-4066-b08c-b30b00811976 tempest-VolumesGetTest-1025537146 None] Created volume successfully.
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "cinder-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c56188-a79e-47be-b7d8-507eb10937cf]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:33 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ef579839-cfbc-4d76-a1d7-7f2918bd806e" returned: 0 in 0.779s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:33 devstack sudo[102605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b
Jul 07 22:50:33 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "cinder-quobyte-ef579839-cfbc-4d76-a1d7-7f2918bd806e" released by "delete_volume" :: held 1.767s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Created reservations ['06db1ab1-7cf1-4e25-91a3-db5294dfc8f3', '0dc58248-20da-40cd-8cb8-4f79a0fa9125', 'eeca5b08-9734-4f2c-8c03-a41fa1a94cd0', '7eab66ef-0846-48ad-a026-5c1088b463dc'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:33 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:33 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:33 devstack sudo[102611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:33 devstack sudo[102611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:34 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" returned: 0 in 0.994s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:34 devstack sudo[102615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b
Jul 07 22:50:34 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:34 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.003s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Deleted volume successfully.
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5785d52-b0e0-42da-ac02-79243121c826 tempest-ProjectReaderTests-680296209 None] Lock "cinder-ef579839-cfbc-4d76-a1d7-7f2918bd806e-delete_volume" released by "delete_volume" :: held 3.023s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:34 devstack sudo[102611]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.887s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:50:34 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" returned: 0 in 0.867s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b" released by "delete_volume" :: held 1.927s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Created reservations ['8e86f132-2fe3-4705-bb87-66b63783d4e4', '2ff095c4-d3d6-4ab3-85a7-731092d8a208', 'a8e6006e-b0c0-4ace-b983-f5a4bcdd0fe8', '836d8af1-8a37-49c9-bf7b-5135fd343f8f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:35 devstack sudo[102620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:35 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-06f59af9-41fa-4171-98dc-9e6c38974fd5-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "cinder-06f59af9-41fa-4171-98dc-9e6c38974fd5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Acquiring lock "cinder-quobyte-06f59af9-41fa-4171-98dc-9e6c38974fd5" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-06f59af9-41fa-4171-98dc-9e6c38974fd5" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab7a443-7d38-45fd-b3d8-09875a933e35]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:35 devstack sudo[102622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:35 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:36 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:36 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:50:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-62936045-675f-49a5-bd9b-c459641f8376 tempest-VolumesGetTest-1025537146 None] Lock "cinder-26fd0be6-fd52-4a9b-b837-d3f5377c5d0b-delete_volume" released by "delete_volume" :: held 3.058s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:36 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 0 in 1.075s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:36 devstack sudo[102629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:36 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:37 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 1 in 0.974s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:50:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:37 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5
Jul 07 22:50:37 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:38 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-06f59af9-41fa-4171-98dc-9e6c38974fd5" returned: 0 in 0.690s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "cinder-quobyte-06f59af9-41fa-4171-98dc-9e6c38974fd5" released by "delete_volume" :: held 2.839s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Created reservations ['2c84aa0b-221a-46e4-86f3-0e6ff16eb2f8', '9adb3f4b-4f86-45e4-8660-746f73f5f642', 'b5819a63-111e-4537-9943-2009afd45495', '66a0672e-c21a-46ed-881b-92e34f665f96'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:38 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:38 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:39 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.776s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Deleted volume successfully.
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (02760856-65a8-45cb-8eab-8a437d500b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3595efda-1674-4aa6-9539-8bf60ac4b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3595efda-1674-4aa6-9539-8bf60ac4b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-792799463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a176e73d-04b9-4fdb-a60b-bb955e2a941f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:39Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27af253-b5da-437d-a500-41404c518d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27af253-b5da-437d-a500-41404c518d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcdba57-3124-4404-b484-e28f0b0e4874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bcdba57-3124-4404-b484-e28f0b0e4874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a176e73d-04b9-4fdb-a60b-bb955e2a941f', 'volume_name': 'volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15269a6a-7b67-437d-b3d2-12dbf1982cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15269a6a-7b67-437d-b3d2-12dbf1982cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c07d20-9159-405a-ade8-751a358941ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Volume a176e73d-04b9-4fdb-a60b-bb955e2a941f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f', 'volume_size': 1}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-792799463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a176e73d-04b9-4fdb-a60b-bb955e2a941f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:39Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Creating volume a176e73d-04b9-4fdb-a60b-bb955e2a941f {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-364a48e8-1a70-472b-84f0-575c0fd880ea tempest-VolumesGetTest-1025537146 None] Lock "cinder-06f59af9-41fa-4171-98dc-9e6c38974fd5-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:39 devstack sudo[102646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f 1073741824
Jul 07 22:50:39 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:40 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f 1073741824" returned: 0 in 0.988s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:40 devstack sudo[102652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f
Jul 07 22:50:40 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:41 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09c07d20-9159-405a-ade8-751a358941ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbbb4f5-f614-4d77-a1e3-352bf3970514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Volume volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f (a176e73d-04b9-4fdb-a60b-bb955e2a941f): created successfully
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bbbb4f5-f614-4d77-a1e3-352bf3970514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (02760856-65a8-45cb-8eab-8a437d500b1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-81fca748-2239-4fe2-ad5d-06ce93c913bf tempest-VolumesListTestJSON-1867431300 None] Created volume successfully.
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (3ab3cfd7-ebf8-407a-a1ea-7f39f0a8b85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e73a547-1361-4366-98eb-bc5f17a36be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e73a547-1361-4366-98eb-bc5f17a36be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1637538325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db068e2-6406-41d8-8e7f-6b64971e2ac1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:42Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f2c1e6-20ae-4707-89b7-b22e5cdb058e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f2c1e6-20ae-4707-89b7-b22e5cdb058e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78731c46-e984-4d39-9bba-3cc5898c5829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78731c46-e984-4d39-9bba-3cc5898c5829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db068e2-6406-41d8-8e7f-6b64971e2ac1', 'volume_name': 'volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6910a691-6a3a-4526-9308-58aeb26ee8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6910a691-6a3a-4526-9308-58aeb26ee8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c52340d-0ca2-4bef-8fc2-b3a1f86328bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:42 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Volume 1db068e2-6406-41d8-8e7f-6b64971e2ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1', 'volume_size': 1}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1637538325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db068e2-6406-41d8-8e7f-6b64971e2ac1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:42Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Creating volume 1db068e2-6406-41d8-8e7f-6b64971e2ac1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:42 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:42 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 1073741824
Jul 07 22:50:42 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:43 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 1073741824" returned: 0 in 1.057s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:43 devstack sudo[102661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1
Jul 07 22:50:43 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:44 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c52340d-0ca2-4bef-8fc2-b3a1f86328bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2889e7-aa53-4103-9e57-c1ecd5ddfd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:44 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Volume volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 (1db068e2-6406-41d8-8e7f-6b64971e2ac1): created successfully
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c2889e7-aa53-4103-9e57-c1ecd5ddfd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:44 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (3ab3cfd7-ebf8-407a-a1ea-7f39f0a8b85f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-65214374-72b0-4d6e-ab5c-44672eb13190 tempest-VolumesListTestJSON-1867431300 None] Created volume successfully.
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Flow 'volume_create_manager' (21cb02fb-b1b2-4df5-b00c-80ea4135fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97553df8-fc09-4d86-9cc7-af969aa57c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97553df8-fc09-4d86-9cc7-af969aa57c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-73136851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7111c42-7add-43a6-880b-41400e4e418c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca9b5f4390b4335a1667268d1adedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:45Z,use_quota=True,user_id='086afa35e9ce41df8a50d05b1dcf6af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca692cc6-e768-4726-bf17-a5886c41c7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca692cc6-e768-4726-bf17-a5886c41c7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ce050f-c3a5-4316-ab24-b4c2db88efe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ce050f-c3a5-4316-ab24-b4c2db88efe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7111c42-7add-43a6-880b-41400e4e418c', 'volume_name': 'volume-c7111c42-7add-43a6-880b-41400e4e418c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5cba9a-7069-471a-b195-d6fc7ca23019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5cba9a-7069-471a-b195-d6fc7ca23019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176984b-92d9-45e7-b30f-a2d8a62a8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:45 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Volume c7111c42-7add-43a6-880b-41400e4e418c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7111c42-7add-43a6-880b-41400e4e418c', 'volume_size': 1}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-73136851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7111c42-7add-43a6-880b-41400e4e418c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fca9b5f4390b4335a1667268d1adedb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:45Z,use_quota=True,user_id='086afa35e9ce41df8a50d05b1dcf6af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Creating volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:45 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:45 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c 1073741824
Jul 07 22:50:45 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:45 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (cc73fc18-dc6b-4f55-8421-34938de3b5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245784ed-6d87-4dd9-b295-8af0b9b5bd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245784ed-6d87-4dd9-b295-8af0b9b5bd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1284222624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9fd530-f61e-45f7-9796-1c158e2ce680,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:46Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb37bd5-3c9b-4451-ab1d-7cceb06f9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb37bd5-3c9b-4451-ab1d-7cceb06f9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bcc12d-4cd2-4c8e-8994-dc3ad5911632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bcc12d-4cd2-4c8e-8994-dc3ad5911632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9fd530-f61e-45f7-9796-1c158e2ce680', 'volume_name': 'volume-1f9fd530-f61e-45f7-9796-1c158e2ce680', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4253fd7c-5628-485f-9aa5-f9f70a54cdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4253fd7c-5628-485f-9aa5-f9f70a54cdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9255e2ef-e7da-4117-912a-f00b2010626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:46 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Volume 1f9fd530-f61e-45f7-9796-1c158e2ce680: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9fd530-f61e-45f7-9796-1c158e2ce680', 'volume_size': 1}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:46 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c 1073741824" returned: 0 in 0.943s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:46 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c
Jul 07 22:50:46 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:47 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1284222624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f9fd530-f61e-45f7-9796-1c158e2ce680,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='02e9c528aebc413a846611db84796f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:50:46Z,use_quota=True,user_id='e0bdfa8f38414a15affafb6ed5f2145e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Creating volume 1f9fd530-f61e-45f7-9796-1c158e2ce680 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:50:47 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:47 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 1073741824
Jul 07 22:50:47 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1176984b-92d9-45e7-b30f-a2d8a62a8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7111c42-7add-43a6-880b-41400e4e418c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb4406b-1fbc-4183-86d2-c47cfec6975a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:47 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Volume volume-c7111c42-7add-43a6-880b-41400e4e418c (c7111c42-7add-43a6-880b-41400e4e418c): created successfully
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdb4406b-1fbc-4183-86d2-c47cfec6975a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Flow 'volume_create_manager' (21cb02fb-b1b2-4df5-b00c-80ea4135fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a6ea1aef-b2a5-4b03-8429-0b65fc464940 tempest-VolumesSnapshotListTestJSON-1170424049 None] Created volume successfully.
Jul 07 22:50:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:48 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 1073741824" returned: 0 in 0.901s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:48 devstack sudo[102678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680
Jul 07 22:50:48 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:48 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680" returned: 0 in 0.654s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.062s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Creating offline snapshot c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9255e2ef-e7da-4117-912a-f00b2010626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9fd530-f61e-45f7-9796-1c158e2ce680', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c98f81a-d29d-477f-bcb1-077921d82bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72827d-ca13-4915-84cf-9fb8ec388c73]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Volume volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 (1f9fd530-f61e-45f7-9796-1c158e2ce680): created successfully
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c98f81a-d29d-477f-bcb1-077921d82bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:50:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Flow 'volume_create_manager' (cc73fc18-dc6b-4f55-8421-34938de3b5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:50:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3dadac18-68b7-48c4-b323-6b79a5ed313d tempest-VolumesListTestJSON-1867431300 None] Created volume successfully.
Jul 07 22:50:48 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c
Jul 07 22:50:48 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:49 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:49 devstack sudo[102686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 1G
Jul 07 22:50:49 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:50 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 1G" returned: 0 in 0.968s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:50 devstack sudo[102691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:50:50 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:51 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.710s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:51 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 is being set with open permissions: ugo+rw
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:51 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:50:51 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-1f9fd530-f61e-45f7-9796-1c158e2ce680-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-1f9fd530-f61e-45f7-9796-1c158e2ce680-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-quobyte-1f9fd530-f61e-45f7-9796-1c158e2ce680" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-1f9fd530-f61e-45f7-9796-1c158e2ce680" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb3ec2a-6e7c-4c1c-adcc-98725304d7e5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:51 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680
Jul 07 22:50:51 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:51 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.643s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:52 devstack sudo[102701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info
Jul 07 22:50:52 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:52 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:52 devstack sudo[102706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680
Jul 07 22:50:52 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:52 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info" returned: 0 in 0.643s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:52 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info is being set with open permissions: ugo+rw
Jul 07 22:50:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:52 devstack sudo[102709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info
Jul 07 22:50:52 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:53 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1f9fd530-f61e-45f7-9796-1c158e2ce680" returned: 0 in 0.638s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-1f9fd530-f61e-45f7-9796-1c158e2ce680" released by "delete_volume" :: held 1.472s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Created reservations ['8b411847-9587-447e-94fc-c61037380763', '403ee0ca-a59f-45ee-ae67-483beaf7dcbb', 'f29c1b24-e86c-4a13-a6c2-683c394fd52c', '4ff297fc-f53b-4b3d-9d55-cf8a28dc825d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:53 devstack sudo[102713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:53 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:53 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.info" returned: 0 in 0.671s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.570s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-df62577e-8f02-4187-a77f-5918e1822b78 tempest-VolumesSnapshotListTestJSON-1170424049 None] Create snapshot completed successfully
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-1db068e2-6406-41d8-8e7f-6b64971e2ac1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-1db068e2-6406-41d8-8e7f-6b64971e2ac1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:53 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-quobyte-1db068e2-6406-41d8-8e7f-6b64971e2ac1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Deleted volume successfully.
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-1db068e2-6406-41d8-8e7f-6b64971e2ac1" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0aca8c3d-a6cd-4606-b0d0-cfed0a1931a7 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-1f9fd530-f61e-45f7-9796-1c158e2ce680-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4ac6c4-af6b-40f7-8c32-3695a59b9847]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:54 devstack sudo[102716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1
Jul 07 22:50:54 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Creating offline snapshot 1e9e8e15-ee29-4c23-9270-47bbcb66995a of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bdbda2-4445-4632-bf69-196b1fa52ed5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:54 devstack sudo[102718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:50:54 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:54 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1" returned: 0 in 0.807s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:54 devstack sudo[102723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1
Jul 07 22:50:54 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:55 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.809s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:55 devstack sudo[102729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a 1G
Jul 07 22:50:55 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:55 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1db068e2-6406-41d8-8e7f-6b64971e2ac1" returned: 0 in 0.687s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-1db068e2-6406-41d8-8e7f-6b64971e2ac1" released by "delete_volume" :: held 1.552s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Created reservations ['4bceac9a-78da-4ee6-8b48-453564621b90', 'd7d5556a-a9a6-4323-b6f6-209223e8acf0', '6c748755-b7f0-4917-9a01-195dcb6dc919', '6efc0455-fdd6-4dc8-bb90-884005a53d45'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:55 devstack sudo[102735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:55 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:55 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a 1G" returned: 0 in 0.870s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:55 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:50:55 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-a176e73d-04b9-4fdb-a60b-bb955e2a941f-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-a176e73d-04b9-4fdb-a60b-bb955e2a941f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "cinder-quobyte-a176e73d-04b9-4fdb-a60b-bb955e2a941f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-a176e73d-04b9-4fdb-a60b-bb955e2a941f" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9a17b-7c6d-42af-8af6-fde301229779]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:56 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.703s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Deleted volume successfully.
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ede35f76-3020-4173-a638-71d2f4ab64c6 tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-1db068e2-6406-41d8-8e7f-6b64971e2ac1-delete_volume" released by "delete_volume" :: held 2.525s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:56 devstack sudo[102742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f
Jul 07 22:50:56 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:56 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.738s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:56 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a is being set with open permissions: ugo+rw
Jul 07 22:50:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:56 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:50:56 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:57 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f" returned: 0 in 0.832s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:57 devstack sudo[102753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f
Jul 07 22:50:57 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:57 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.656s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.178s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ae7db072-317b-46e5-b84c-733201fa0f77 tempest-VolumesSnapshotListTestJSON-1170424049 None] Create snapshot completed successfully
Jul 07 22:50:57 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a176e73d-04b9-4fdb-a60b-bb955e2a941f" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-quobyte-a176e73d-04b9-4fdb-a60b-bb955e2a941f" released by "delete_volume" :: held 1.571s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:57 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Created reservations ['c10ee7df-4e58-4c2a-a648-f327515fc00b', '434696eb-96c9-41eb-9d58-80cf553e5700', '9a2b7fb0-d2dc-4919-9014-6cb4fe145854', 'dc07da40-e0c9-4f2e-91f6-122a8799e88f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:58 devstack sudo[102758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:50:58 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Creating offline snapshot 151e0abc-c659-466b-95d1-e6cdd813339e of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[528ba720-8251-4206-84ed-e6cc926c980f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:58 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.765s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:50:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Deleted volume successfully.
Jul 07 22:50:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-1b36d32b-75d8-4036-b07b-6b35f556cb9f tempest-VolumesListTestJSON-1867431300 None] Lock "cinder-a176e73d-04b9-4fdb-a60b-bb955e2a941f-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:50:58 devstack sudo[102761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:50:58 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:50:59 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root
Jul 07 22:50:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.856s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:50:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:50:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:50:59 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e 1G
Jul 07 22:50:59 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:00 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e 1G" returned: 0 in 0.950s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:00 devstack sudo[102774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e
Jul 07 22:51:00 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:01 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:01 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e is being set with open permissions: ugo+rw
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:01 devstack sudo[102779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e
Jul 07 22:51:01 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Flow 'volume_create_manager' (eab52ab9-2bc7-460b-b8e1-f9602603b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66dfde-1b16-4ca4-9fc1-012e364aaf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66dfde-1b16-4ca4-9fc1-012e364aaf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-366436544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4581ee-4102-4102-96d0-ea1f5d7d887d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c5f13762d940b8a135137471474ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:02Z,use_quota=True,user_id='8c280677a58147819bea1e6208151234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc56969-edf5-4d3d-9afd-6adab422c264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc56969-edf5-4d3d-9afd-6adab422c264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab633f9-8afc-42b2-ae40-b66dd52ef528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aab633f9-8afc-42b2-ae40-b66dd52ef528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4581ee-4102-4102-96d0-ea1f5d7d887d', 'volume_name': 'volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14683f15-9873-4029-a803-84e313a2a984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:01 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14683f15-9873-4029-a803-84e313a2a984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f146e2c-ccf4-4074-8b7d-37805790f60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:01 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Volume 3e4581ee-4102-4102-96d0-ea1f5d7d887d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d', 'volume_size': 1}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e" returned: 0 in 0.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.361s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-366436544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4581ee-4102-4102-96d0-ea1f5d7d887d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30c5f13762d940b8a135137471474ff7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:02Z,use_quota=True,user_id='8c280677a58147819bea1e6208151234',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Creating volume 3e4581ee-4102-4102-96d0-ea1f5d7d887d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:02 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:02 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d 1073741824
Jul 07 22:51:02 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ec4b7645-3544-41b0-b473-c4d9b34c222b tempest-VolumesSnapshotListTestJSON-1170424049 None] Create snapshot completed successfully
Jul 07 22:51:02 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d 1073741824" returned: 0 in 0.876s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:02 devstack sudo[102788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d
Jul 07 22:51:02 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:03 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d" returned: 0 in 0.752s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f146e2c-ccf4-4074-8b7d-37805790f60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ffb839-529c-4b70-b5c4-25e531ba67cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-151e0abc-c659-466b-95d1-e6cdd813339e-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Volume volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d (3e4581ee-4102-4102-96d0-ea1f5d7d887d): created successfully
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94ffb839-529c-4b70-b5c4-25e531ba67cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Flow 'volume_create_manager' (eab52ab9-2bc7-460b-b8e1-f9602603b766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-151e0abc-c659-466b-95d1-e6cdd813339e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ad9997f0-c05f-42a9-8924-828ad50420b5 tempest-VolumesNegativeTest-275838203 None] Created volume successfully.
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-151e0abc-c659-466b-95d1-e6cdd813339e" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-151e0abc-c659-466b-95d1-e6cdd813339e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Deleting offline snapshot 151e0abc-c659-466b-95d1-e6cdd813339e of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] snapshot_file for this snap is: volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398284b-64d5-4ea8-85e9-daed27d0b4df]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:03 devstack sudo[102827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e
Jul 07 22:51:03 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:04 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e" returned: 0 in 0.769s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8006dbef-53a4-49c8-ae71-1bc3a739aebe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:04 devstack sudo[102832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:51:04 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:05 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:05 devstack sudo[102837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e
Jul 07 22:51:05 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:06 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e" returned: 0 in 0.909s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:06 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e
Jul 07 22:51:06 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:07 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.151e0abc-c659-466b-95d1-e6cdd813339e" returned: 0 in 0.790s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-151e0abc-c659-466b-95d1-e6cdd813339e" released by "_delete_snapshot" :: held 3.415s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" released by "delete_snapshot" :: held 3.443s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Created reservations ['1a33c4b5-5b4e-4bbc-96d1-6170e93ecb0a', '3912e749-0c8b-4eba-b5d8-76588bddf8b7', 'a8b515ed-e112-4a6e-87b3-dfc6eba1f45f', 'c25f65a8-c16f-4f2f-9db5-2fb4466e6851'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Delete snapshot completed successfully.
Jul 07 22:51:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-61352bc7-40b6-4b75-ac00-8f1d607a4cff tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-151e0abc-c659-466b-95d1-e6cdd813339e-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-1e9e8e15-ee29-4c23-9270-47bbcb66995a-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-1e9e8e15-ee29-4c23-9270-47bbcb66995a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-1e9e8e15-ee29-4c23-9270-47bbcb66995a" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-1e9e8e15-ee29-4c23-9270-47bbcb66995a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Deleting offline snapshot 1e9e8e15-ee29-4c23-9270-47bbcb66995a of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] snapshot_file for this snap is: volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c35435e-97f5-4f7b-b61f-0a156a705cd2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:08 devstack sudo[102850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:51:08 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:08 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.733s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[97270bed-e88d-4be4-a96f-48f4c8d70b93]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:09 devstack sudo[102855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:51:09 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:09 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.744s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:09 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:51:09 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:10 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:10 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a
Jul 07 22:51:10 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:11 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.1e9e8e15-ee29-4c23-9270-47bbcb66995a" returned: 0 in 0.642s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-1e9e8e15-ee29-4c23-9270-47bbcb66995a" released by "_delete_snapshot" :: held 3.050s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" released by "delete_snapshot" :: held 3.073s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=80,cinder:UPDATE=101,cinder:INSERT=25,cinder:DELETE=9 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=79,cinder:UPDATE=103,cinder:INSERT=33,cinder:DELETE=11 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Created reservations ['6d5e2729-26a0-49a2-aa3f-9bc3eb1bee00', '5b02cb5a-4732-4051-8190-5218d37857c9', 'dde24b10-3013-477d-8bb0-64b9000eefe7', 'ad5dfa14-4473-4dd7-a995-08bbb31c6bdf'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Delete snapshot completed successfully.
Jul 07 22:51:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3f3bd54f-4177-4b8d-88f4-48ebe0c4e4ea tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-1e9e8e15-ee29-4c23-9270-47bbcb66995a-delete_snapshot" released by "delete_snapshot" :: held 3.239s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Deleting offline snapshot c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 of volume c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] snapshot_file for this snap is: volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdccc69-3885-4e12-9568-ac41bccb0ba0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:12 devstack sudo[102868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:51:12 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:13 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.880s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7111c42-7add-43a6-880b-41400e4e418c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ad916e-7772-44cb-a671-1aed127c6575]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:13 devstack sudo[102879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c
Jul 07 22:51:13 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:14 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c" returned: 0 in 0.796s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:14 devstack sudo[102896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:51:14 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:14 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.738s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:14 devstack sudo[102901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11
Jul 07 22:51:14 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:15 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c.c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11" released by "_delete_snapshot" :: held 3.229s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" released by "delete_snapshot" :: held 3.255s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:15 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Created reservations ['052e798d-c183-494f-927f-2325d404cd9b', '22e7068e-2e4b-40e3-a4d5-ab2146e12d4a', '048835a2-b281-4fc8-b616-37ee9b873a52', '124675e9-67dd-48fc-b6d6-506d3c74a9a5'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Delete snapshot completed successfully.
Jul 07 22:51:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5cfe424c-44f0-4dcf-a3dc-8733d2d65cf7 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-c8d90ebc-6d6e-44ee-b2f4-1eaa7b1ffe11-delete_snapshot" released by "delete_snapshot" :: held 3.421s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-c7111c42-7add-43a6-880b-41400e4e418c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-c7111c42-7add-43a6-880b-41400e4e418c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1f2bca-225c-47fa-a81a-df225fd8be0d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:16 devstack sudo[102905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c
Jul 07 22:51:16 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:17 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c" returned: 0 in 1.027s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:17 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c
Jul 07 22:51:17 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:18 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7111c42-7add-43a6-880b-41400e4e418c" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-quobyte-c7111c42-7add-43a6-880b-41400e4e418c" released by "delete_volume" :: held 1.849s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Created reservations ['e562a43a-3758-42a5-8c07-ca34e478d625', '06f25199-48e0-48c2-bfc1-c7c6aa4d40a1', '5c1cdabe-c840-45cb-81da-9e27a6e74a01', '09332ade-9dde-4f56-81e8-cf0107f42da1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:18 devstack sudo[102959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:51:18 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:19 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.764s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:19 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Deleted volume successfully.
Jul 07 22:51:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5f7f03d0-cfa0-47b8-aee5-7546ad9ae470 tempest-VolumesSnapshotListTestJSON-1170424049 None] Lock "cinder-c7111c42-7add-43a6-880b-41400e4e418c-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Flow 'volume_create_manager' (b32a3e70-b152-4ec2-9f5d-d34f2f41dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6635217d-e720-4d03-bf9b-b9fa88032fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6635217d-e720-4d03-bf9b-b9fa88032fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed2d67f-b4d7-4637-8d09-ee698cdb540b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4faf84256cbb48378761c79791877f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:26Z,use_quota=True,user_id='a50a1f883e27433f88a1f312e12966e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e694a15c-5124-4300-ae2d-c04ee2f38823),volume_type_id=e694a15c-5124-4300-ae2d-c04ee2f38823)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffc940a-44c0-4df2-8298-a5b73f36c943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ffc940a-44c0-4df2-8298-a5b73f36c943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bee704-f279-4577-969d-dcae7de92a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80bee704-f279-4577-969d-dcae7de92a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ed2d67f-b4d7-4637-8d09-ee698cdb540b', 'volume_name': 'volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b', 'volume_size': 1, 'image_id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ad1c24ed5bd61dd12dfe7506f211744', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4faf84256cbb48378761c79791877f76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7088d62e3cdf215b861bbecef2a0d957b39e23a05bda56a3a2333f12a521658265539c9152f46e310d42f53aa34bd845e584881d5061c355f7b85b3966c67eeb', 'id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'created_at': datetime.datetime(2026, 7, 7, 20, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f60980>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808a6790-ebcd-4c98-b700-a04178486640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (808a6790-ebcd-4c98-b700-a04178486640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04272aa6-2188-4a3e-8924-977b8611aeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b', 'volume_size': 1, 'image_id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ad1c24ed5bd61dd12dfe7506f211744', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4faf84256cbb48378761c79791877f76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7088d62e3cdf215b861bbecef2a0d957b39e23a05bda56a3a2333f12a521658265539c9152f46e310d42f53aa34bd845e584881d5061c355f7b85b3966c67eeb', 'id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'created_at': datetime.datetime(2026, 7, 7, 20, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f60980>}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Trying to clone 7ed2d67f-b4d7-4637-8d09-ee698cdb540b from image e4c94f96-f7de-438e-9c2c-27e7b6c91924 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:51:26 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ba785e-97b7-4c76-82c8-8ccfb3d80c21]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:26 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:26 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:27 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:27 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:27 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:28 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 1 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:28 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Temporary image e4c94f96-f7de-438e-9c2c-27e7b6c91924 is fetched for user a50a1f883e27433f88a1f312e12966e0. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:51:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a51f17b-9462-4292-accf-d3d1f11b48c1]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:28 devstack sudo[103016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:28 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:29 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:29 devstack sudo[103020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:29 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:30 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 1 in 0.848s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed2d67f-b4d7-4637-8d09-ee698cdb540b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4faf84256cbb48378761c79791877f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:26Z,use_quota=True,user_id='a50a1f883e27433f88a1f312e12966e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e694a15c-5124-4300-ae2d-c04ee2f38823),volume_type_id=e694a15c-5124-4300-ae2d-c04ee2f38823)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Creating volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:30 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:30 devstack sudo[103025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1073741824
Jul 07 22:51:30 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:30 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1073741824" returned: 0 in 0.863s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:31 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:31 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:31 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Attempting download of e4c94f96-f7de-438e-9c2c-27e7b6c91924 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}])) to volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[427b333e-ae06-40b1-87ad-95e59e88dd7a]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:31 devstack sudo[103034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh
Jul 07 22:51:31 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:32 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh" returned: 0 in 0.769s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:32 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh
Jul 07 22:51:32 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:33 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh" returned: 1 in 0.753s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4c94f96-f7de-438e-9c2c-27e7b6c91924_5n3754qh' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[99678fdf-1845-451b-8ce0-48a58276f2ad]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:33 devstack sudo[103042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:33 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:33 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:51:33 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:34 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:34 devstack sudo[103048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD
Jul 07 22:51:34 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:34 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.743s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:51:34 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD" returned: 1 in 0.756s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] e4c94f96-f7de-438e-9c2c-27e7b6c91924 was raw, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:51:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:34 devstack sudo[103054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:34 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Acquiring lock "cinder-3e4581ee-4102-4102-96d0-ea1f5d7d887d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "cinder-3e4581ee-4102-4102-96d0-ea1f5d7d887d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Acquiring lock "cinder-quobyte-3e4581ee-4102-4102-96d0-ea1f5d7d887d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "cinder-quobyte-3e4581ee-4102-4102-96d0-ea1f5d7d887d" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8783dc44-e57a-4c13-b059-45439af04b93]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:35 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 0 in 0.776s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4c94f96-f7de-438e-9c2c-27e7b6c91924_qbaajxiidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:51:35 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 22:51:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:35 devstack sudo[103060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1G
Jul 07 22:51:35 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:35 devstack sudo[103059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d
Jul 07 22:51:35 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:36 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b 1G" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:36 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d" returned: 0 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f510c39-7ca0-48a3-b111-f95d07e4361e]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:36 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d
Jul 07 22:51:36 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:36 devstack sudo[103071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:36 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:37 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3e4581ee-4102-4102-96d0-ea1f5d7d887d" returned: 0 in 0.699s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "cinder-quobyte-3e4581ee-4102-4102-96d0-ea1f5d7d887d" released by "delete_volume" :: held 1.532s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Created reservations ['6457f24e-1e20-4ac3-bdfb-db09b5444d80', '69855495-6690-45cf-890d-b804cb950135', '34d7e958-9a83-4386-a284-405d3a4b8fec', 'e6c6e81e-c545-4c42-b60c-201b2365226d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:37 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:37 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:51:37 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:37 devstack sudo[103077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:37 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:37 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Deleted volume successfully.
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-507f26f7-80b3-432c-b8e6-44dec7a88e94 tempest-VolumesNegativeTest-275838203 None] Lock "cinder-3e4581ee-4102-4102-96d0-ea1f5d7d887d-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:37 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 1 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Downloaded image e4c94f96-f7de-438e-9c2c-27e7b6c91924 ((None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}])) to volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Temporary image e4c94f96-f7de-438e-9c2c-27e7b6c91924 for user a50a1f883e27433f88a1f312e12966e0 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Marking volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Copying metadata from image e4c94f96-f7de-438e-9c2c-27e7b6c91924 to 7ed2d67f-b4d7-4637-8d09-ee698cdb540b. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:51:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Creating volume glance metadata for volume 7ed2d67f-b4d7-4637-8d09-ee698cdb540b backed by image e4c94f96-f7de-438e-9c2c-27e7b6c91924 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6ad1c24ed5bd61dd12dfe7506f211744', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:51:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04272aa6-2188-4a3e-8924-977b8611aeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b', 'volume_size': 1, 'image_id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ad1c24ed5bd61dd12dfe7506f211744', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4faf84256cbb48378761c79791877f76', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7088d62e3cdf215b861bbecef2a0d957b39e23a05bda56a3a2333f12a521658265539c9152f46e310d42f53aa34bd845e584881d5061c355f7b85b3966c67eeb', 'id': 'e4c94f96-f7de-438e-9c2c-27e7b6c91924', 'created_at': datetime.datetime(2026, 7, 7, 20, 51, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 51, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4c94f96-f7de-438e-9c2c-27e7b6c91924/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe69f60980>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4331431-a895-4be4-b9b1-30d7e796f675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:38 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Volume volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b (7ed2d67f-b4d7-4637-8d09-ee698cdb540b): created successfully
Jul 07 22:51:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4331431-a895-4be4-b9b1-30d7e796f675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:38 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Flow 'volume_create_manager' (b32a3e70-b152-4ec2-9f5d-d34f2f41dc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1120b5c6-bfce-4558-871b-e40c9b782ee1 tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Created volume successfully.
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Acquiring lock "cinder-7ed2d67f-b4d7-4637-8d09-ee698cdb540b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "cinder-7ed2d67f-b4d7-4637-8d09-ee698cdb540b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Acquiring lock "cinder-quobyte-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "cinder-quobyte-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53a20df-3b96-4ca8-8774-e97d9e785a0f]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:39 devstack sudo[103091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:39 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:40 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 0 in 0.919s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:40 devstack sudo[103095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:40 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Flow 'volume_create_manager' (2c2a4aa9-43a6-427c-b4dd-5fb99124eacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94c298-1ea1-4f18-866d-3f0a1cbf580f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b94c298-1ea1-4f18-866d-3f0a1cbf580f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-129253462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68450101-b9ef-4cd4-a08c-5df4bae46bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6425e38d4e724d53b5276cfa22bf1b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:40Z,use_quota=True,user_id='6d2366baccba4a69a3e0d1fe35be4672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2865a1-7ece-4e56-8eb1-48b31642497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2865a1-7ece-4e56-8eb1-48b31642497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd32702c-1c18-4779-9f40-4d015beb4ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd32702c-1c18-4779-9f40-4d015beb4ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68450101-b9ef-4cd4-a08c-5df4bae46bd1', 'volume_name': 'volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1', 'volume_size': 2}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7de5a3-b88c-46b5-9c20-e8c85fc85960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7de5a3-b88c-46b5-9c20-e8c85fc85960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c2f006-976c-4a87-b589-0de6132aba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Volume 68450101-b9ef-4cd4-a08c-5df4bae46bd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1', 'volume_size': 2}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-129253462',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68450101-b9ef-4cd4-a08c-5df4bae46bd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6425e38d4e724d53b5276cfa22bf1b6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:40Z,use_quota=True,user_id='6d2366baccba4a69a3e0d1fe35be4672',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Creating volume 68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:40 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 2147483648 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:40 devstack sudo[103097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 2147483648
Jul 07 22:51:40 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:40 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 1 in 0.801s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:51:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:40 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b
Jul 07 22:51:40 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:41 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 2147483648" returned: 0 in 0.870s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:41 devstack sudo[103107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1
Jul 07 22:51:41 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:41 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" returned: 0 in 0.683s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "cinder-quobyte-7ed2d67f-b4d7-4637-8d09-ee698cdb540b" released by "delete_volume" :: held 2.469s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:41 devstack cinder-volume[88152]: WARNING cinder.quota [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:51:41 devstack cinder-volume[88152]: WARNING cinder.quota [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Created reservations ['7aeea0b7-91f1-41f0-9484-0ae25830438d', '02ecdcf1-9db2-4308-a2a7-a8c5e0f5b051', '11f4410a-1a23-4efe-af8a-8d937c30bf37', '62fdc41c-1cea-44e9-b3d5-4c2f87a1f291'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:41 devstack sudo[103110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:51:41 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:42 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1" returned: 0 in 0.646s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c2f006-976c-4a87-b589-0de6132aba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1', 'volume_size': 2}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f84b69-0023-401f-adfe-77644fb97612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:42 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Volume volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 (68450101-b9ef-4cd4-a08c-5df4bae46bd1): created successfully
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f84b69-0023-401f-adfe-77644fb97612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Flow 'volume_create_manager' (2c2a4aa9-43a6-427c-b4dd-5fb99124eacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-45144c46-7f27-4594-82d9-29fe7e35d8f8 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Created volume successfully.
Jul 07 22:51:42 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.661s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Deleted volume successfully.
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-af7d63e1-7d3e-498f-af68-1a2979e090ce tempest-VolumeAndVolumeTypeFromImageTest-622796075 None] Lock "cinder-7ed2d67f-b4d7-4637-8d09-ee698cdb540b-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Creating offline snapshot 6465654a-eb92-4dc9-85e3-15aefbf58461 of volume 68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f6cfe-a10a-41c0-a16f-106e5d7aa6c8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:42 devstack sudo[103114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1
Jul 07 22:51:42 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:43 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 2G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:43 devstack sudo[103119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 2G
Jul 07 22:51:43 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:44 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 2G" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:44 devstack sudo[103125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461
Jul 07 22:51:44 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:45 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461" returned: 0 in 0.766s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 is being set with open permissions: ugo+rw
Jul 07 22:51:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:45 devstack sudo[103130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461
Jul 07 22:51:45 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:45 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461" returned: 0 in 0.638s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:45 devstack sudo[103133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info
Jul 07 22:51:45 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:46 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info" returned: 0 in 0.657s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:46 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info is being set with open permissions: ugo+rw
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:46 devstack sudo[103137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info
Jul 07 22:51:46 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Flow 'volume_create_manager' (eb9b2322-5606-4642-a322-64f03a175e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf89cee-d7c4-46b0-ae80-2e49add0aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf89cee-d7c4-46b0-ae80-2e49add0aedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641fb9ce-665e-44fb-873d-727d0e919fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cef7c2c324c470d8b903d90b75b8439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:47Z,use_quota=True,user_id='41a561d060664c01b5c13d58a4bfd511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafa173a-a03f-4b12-87c4-1c4d9afdbd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cafa173a-a03f-4b12-87c4-1c4d9afdbd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae07b756-0b8b-4c58-a4c4-49207c6d0701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae07b756-0b8b-4c58-a4c4-49207c6d0701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641fb9ce-665e-44fb-873d-727d0e919fc7', 'volume_name': 'volume-641fb9ce-665e-44fb-873d-727d0e919fc7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5e98e8-28a1-43b2-a5cc-4a96274221b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5e98e8-28a1-43b2-a5cc-4a96274221b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04812d57-97d2-407d-a1dc-48b1d831c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:46 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Volume 641fb9ce-665e-44fb-873d-727d0e919fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641fb9ce-665e-44fb-873d-727d0e919fc7', 'volume_size': 1}
Jul 07 22:51:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:47 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.info" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.272s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641fb9ce-665e-44fb-873d-727d0e919fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cef7c2c324c470d8b903d90b75b8439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:47Z,use_quota=True,user_id='41a561d060664c01b5c13d58a4bfd511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Creating volume 641fb9ce-665e-44fb-873d-727d0e919fc7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:47 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:51:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:47 devstack sudo[103140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 1073741824
Jul 07 22:51:47 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fd9c15fa-f487-467d-b5e9-cd23a416fc6a tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Create snapshot completed successfully
Jul 07 22:51:48 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 1073741824" returned: 0 in 0.892s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:48 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7
Jul 07 22:51:48 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "cinder-6465654a-eb92-4dc9-85e3-15aefbf58461-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-6465654a-eb92-4dc9-85e3-15aefbf58461-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "cinder-quobyte-6465654a-eb92-4dc9-85e3-15aefbf58461" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-6465654a-eb92-4dc9-85e3-15aefbf58461" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Deleting offline snapshot 6465654a-eb92-4dc9-85e3-15aefbf58461 of volume 68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] snapshot_file for this snap is: volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fe9308-5398-49d5-8bb8-c84f2224b871]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:48 devstack sudo[103149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461
Jul 07 22:51:48 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:48 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7" returned: 0 in 0.619s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04812d57-97d2-407d-a1dc-48b1d831c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641fb9ce-665e-44fb-873d-727d0e919fc7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591a8614-cc3c-4eed-8a72-acc8928994df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Volume volume-641fb9ce-665e-44fb-873d-727d0e919fc7 (641fb9ce-665e-44fb-873d-727d0e919fc7): created successfully
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (591a8614-cc3c-4eed-8a72-acc8928994df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Flow 'volume_create_manager' (eb9b2322-5606-4642-a322-64f03a175e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-18fe8895-d940-4ad3-9ba2-8bfe6d71760a tempest-CinderUnicodeTest-465266146 None] Created volume successfully.
Jul 07 22:51:49 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461" returned: 0 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7005b8ab-ac7f-4672-b86d-78bbb8cb27e4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:49 devstack sudo[103155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1
Jul 07 22:51:49 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Flow 'volume_create_manager' (bf7dc039-ddf5-4263-9fa9-9dfba67532d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da65abea-8449-441c-b624-e8c3f52d6a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da65abea-8449-441c-b624-e8c3f52d6a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716324601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cef7c2c324c470d8b903d90b75b8439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:49Z,use_quota=True,user_id='41a561d060664c01b5c13d58a4bfd511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d92d07-505b-428e-9090-2d763749d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d92d07-505b-428e-9090-2d763749d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d947a043-9bca-495d-b82a-4a47afaec92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d947a043-9bca-495d-b82a-4a47afaec92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8', 'volume_name': 'volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddeecd8-a686-4927-a47a-5042e463e49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ddeecd8-a686-4927-a47a-5042e463e49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40745b17-777e-498e-9e66-dd6e9e614723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Volume 9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8', 'volume_size': 1}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:51:49Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-716324601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cef7c2c324c470d8b903d90b75b8439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:51:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:51:49Z,use_quota=True,user_id='41a561d060664c01b5c13d58a4bfd511',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Creating volume 9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:51:49 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:49 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 1073741824
Jul 07 22:51:49 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:49 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1" returned: 0 in 0.781s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:49 devstack sudo[103162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461
Jul 07 22:51:49 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:50 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 1073741824" returned: 0 in 0.809s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:50 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8
Jul 07 22:51:50 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:50 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461" returned: 0 in 0.738s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:50 devstack sudo[103172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461
Jul 07 22:51:50 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:51 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" returned: 0 in 0.637s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40745b17-777e-498e-9e66-dd6e9e614723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cbeaf2-886d-498f-8bbb-8b705e2bfd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:51:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Volume volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 (9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8): created successfully
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27cbeaf2-886d-498f-8bbb-8b705e2bfd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Flow 'volume_create_manager' (bf7dc039-ddf5-4263-9fa9-9dfba67532d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:51:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-69f7e345-4f15-433c-8282-3814d2a6f156 tempest-CinderUnicodeTest-465266146 None] Created volume successfully.
Jul 07 22:51:51 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1.6465654a-eb92-4dc9-85e3-15aefbf58461" returned: 0 in 0.618s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-6465654a-eb92-4dc9-85e3-15aefbf58461" released by "_delete_snapshot" :: held 3.017s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" released by "delete_snapshot" :: held 3.038s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Created reservations ['2b8fea65-5c40-40ea-a7af-176517f30fd6', 'd83c40b9-2754-4cda-8ff2-96375328e21a', '8c49798f-826d-4dfe-bea8-692fc1770023', '78a88670-3a2b-466a-9578-1472b62d8d25'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Delete snapshot completed successfully.
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-dae6fac4-66d5-40e7-8a44-1e03731565bf tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-6465654a-eb92-4dc9-85e3-15aefbf58461-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Creating offline snapshot aa179111-5caf-4dde-9078-1e07ae813199 of volume 9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2da39b-f5d2-417e-9194-70e1e2d20694]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:51 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8
Jul 07 22:51:51 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "cinder-68450101-b9ef-4cd4-a08c-5df4bae46bd1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:52 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" returned: 0 in 0.788s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-68450101-b9ef-4cd4-a08c-5df4bae46bd1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:52 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 1G
Jul 07 22:51:52 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ce734c-22ff-49bf-9bab-c417aa3dcc12]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:52 devstack sudo[103183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1
Jul 07 22:51:52 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:53 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 1G" returned: 0 in 0.836s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:53 devstack sudo[103191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199
Jul 07 22:51:53 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:53 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1" returned: 0 in 0.775s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:53 devstack sudo[103193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1
Jul 07 22:51:53 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:54 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:54 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 is being set with open permissions: ugo+rw
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:54 devstack sudo[103199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199
Jul 07 22:51:54 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:54 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-68450101-b9ef-4cd4-a08c-5df4bae46bd1" returned: 0 in 0.682s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-quobyte-68450101-b9ef-4cd4-a08c-5df4bae46bd1" released by "delete_volume" :: held 1.518s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Created reservations ['a0c9662b-1efa-4451-8639-7990720e8eb4', 'd8de8cab-c312-4db1-80b1-9bf852529936', '1759004d-2f76-4ceb-acd3-1192b3d2cea8', '716080b9-1c4b-4ac9-b591-241a89f17055'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:54 devstack sudo[103201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:51:54 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:54 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199" returned: 0 in 0.649s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:54 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info
Jul 07 22:51:54 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:55 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:55 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:51:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Deleted volume successfully.
Jul 07 22:51:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50c69f2c-538c-472b-a960-5cfc7c896092 tempest-VolumesSnapshotNegativeTestJSON-969326683 None] Lock "cinder-68450101-b9ef-4cd4-a08c-5df4bae46bd1-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:51:55 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:55 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info is being set with open permissions: ugo+rw
Jul 07 22:51:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:55 devstack sudo[103209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info
Jul 07 22:51:55 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:56 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.info" returned: 0 in 0.669s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.437s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:51:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9b0c763d-fe82-411c-80ce-b4fe87d77fa6 tempest-CinderUnicodeTest-465266146 None] Create snapshot completed successfully
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-aa179111-5caf-4dde-9078-1e07ae813199-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-aa179111-5caf-4dde-9078-1e07ae813199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-quobyte-aa179111-5caf-4dde-9078-1e07ae813199" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-aa179111-5caf-4dde-9078-1e07ae813199" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Deleting offline snapshot aa179111-5caf-4dde-9078-1e07ae813199 of volume 9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] snapshot_file for this snap is: volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f2b132-780c-43f3-bbf2-7b1bc2d1b912]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:57 devstack sudo[103213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199
Jul 07 22:51:57 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:58 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199" returned: 0 in 0.923s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:51:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ee19b-1e0c-46a3-882e-e16effa1ff89]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:51:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:58 devstack sudo[103222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8
Jul 07 22:51:58 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:58 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" returned: 0 in 0.896s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:59 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199
Jul 07 22:51:59 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:51:59 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Jul 07 22:51:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199" returned: 0 in 0.817s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:51:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:51:59 devstack sudo[103232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199
Jul 07 22:51:59 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:00 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8.aa179111-5caf-4dde-9078-1e07ae813199" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-aa179111-5caf-4dde-9078-1e07ae813199" released by "_delete_snapshot" :: held 3.424s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" released by "delete_snapshot" :: held 3.450s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:00 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Created reservations ['238f5ba0-d601-4265-a35d-b43fdd34af89', 'cbc04252-d367-406a-9bc9-6036f3973c31', '6010765e-847a-4a18-922d-fdb0ce8eb511', 'e8e45f58-4cdb-4c10-970b-af2a9d19bbbd'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Delete snapshot completed successfully.
Jul 07 22:52:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-39d8e347-c8aa-4ef6-b027-0afc1354bd22 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-aa179111-5caf-4dde-9078-1e07ae813199-delete_snapshot" released by "delete_snapshot" :: held 3.601s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b614daa-9d57-4a09-b88e-1b2efbf635ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:01 devstack sudo[103236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8
Jul 07 22:52:01 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:02 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" returned: 0 in 1.012s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:02 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8
Jul 07 22:52:02 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:03 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8" released by "delete_volume" :: held 1.810s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Created reservations ['4d8fcba1-b972-41e1-9cc6-d6de16a3b039', '2faf15eb-ce38-4496-a0d9-52980ab0f6d4', '8b71bec8-2fc3-466c-94e2-c7edaba5883d', '4fa9e59d-c6a5-4501-944e-0a582cf6a546'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:03 devstack sudo[103244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:03 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-641fb9ce-665e-44fb-873d-727d0e919fc7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-641fb9ce-665e-44fb-873d-727d0e919fc7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "cinder-quobyte-641fb9ce-665e-44fb-873d-727d0e919fc7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-641fb9ce-665e-44fb-873d-727d0e919fc7" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef97d13f-39ba-4c1c-98f3-99641afec504]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:03 devstack sudo[103280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7
Jul 07 22:52:03 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:04 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:04 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Deleted volume successfully.
Jul 07 22:52:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0f9760ac-0755-48af-8fd8-23279f083f20 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-9f2c1605-8c5c-4aaa-92e9-44cea5dec8c8-delete_volume" released by "delete_volume" :: held 2.926s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:04 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7" returned: 0 in 1.053s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:04 devstack sudo[103289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7
Jul 07 22:52:04 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:05 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-641fb9ce-665e-44fb-873d-727d0e919fc7" returned: 0 in 0.716s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-quobyte-641fb9ce-665e-44fb-873d-727d0e919fc7" released by "delete_volume" :: held 1.844s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Created reservations ['e133b929-1123-4d90-b345-cde39c7e3ba3', 'fb9f3c15-a082-4039-b986-2703e158c11d', 'a288723c-a773-4251-a9c1-e681690ecbe1', '79fab925-cdae-4bd7-89c8-05bccb156df7'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:05 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:05 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:06 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:06 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Deleted volume successfully.
Jul 07 22:52:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-904a82ec-5a4d-4dbd-acd2-a80b556b9547 tempest-CinderUnicodeTest-465266146 None] Lock "cinder-641fb9ce-665e-44fb-873d-727d0e919fc7-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (9a599a34-e8aa-4a90-8742-2611314a86c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25103c2c-c15e-4f24-9650-632d643c2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25103c2c-c15e-4f24-9650-632d643c2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750797374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d3ef2-dd2b-4172-8e96-2b4929f9719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:10Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1858922-96e6-45ca-874c-fd89a20dd144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1858922-96e6-45ca-874c-fd89a20dd144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464cf1-8e9c-4425-b9c5-48a789d2d715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6464cf1-8e9c-4425-b9c5-48a789d2d715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18d3ef2-dd2b-4172-8e96-2b4929f9719e', 'volume_name': 'volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d15b46-8f98-49ed-9f55-ae65ef3a90cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d15b46-8f98-49ed-9f55-ae65ef3a90cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfd9abc-a4df-4aee-8c79-fb5ae89936ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Volume b18d3ef2-dd2b-4172-8e96-2b4929f9719e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e', 'volume_size': 1}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-750797374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18d3ef2-dd2b-4172-8e96-2b4929f9719e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:10Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Creating volume b18d3ef2-dd2b-4172-8e96-2b4929f9719e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:09 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:09 devstack sudo[103298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e 1073741824
Jul 07 22:52:09 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:10 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e 1073741824" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:10 devstack sudo[103305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e
Jul 07 22:52:10 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:11 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:INSERT=27,cinder:UPDATE=93,cinder:SELECT=73,cinder:DELETE=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adfd9abc-a4df-4aee-8c79-fb5ae89936ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a751ce-d618-466b-ae34-547cb82790ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=73,cinder:INSERT=30,cinder:UPDATE=85,cinder:DELETE=7 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:52:11 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Volume volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e (b18d3ef2-dd2b-4172-8e96-2b4929f9719e): created successfully
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a751ce-d618-466b-ae34-547cb82790ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (9a599a34-e8aa-4a90-8742-2611314a86c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-85f5722b-92a5-462d-be0f-256b05d3c8d6 tempest-ProjectReaderTests-1258239376 None] Created volume successfully.
Jul 07 22:52:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-b18d3ef2-dd2b-4172-8e96-2b4929f9719e-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-b18d3ef2-dd2b-4172-8e96-2b4929f9719e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-quobyte-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:12 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2aa432-60d6-4983-8afc-940a2ba8ec13]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:12 devstack sudo[103308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e
Jul 07 22:52:12 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:13 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" returned: 0 in 1.023s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:13 devstack sudo[103313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e
Jul 07 22:52:13 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:13 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" returned: 0 in 0.719s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-b18d3ef2-dd2b-4172-8e96-2b4929f9719e" released by "delete_volume" :: held 1.793s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:13 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Created reservations ['b25acd75-4887-464a-9f47-170696ab093b', '7df9b1fd-79da-404a-8b2e-9acf79f330ec', '3f26e257-297d-42f2-b76e-13c10661b18b', '703ad70c-9f9e-4db8-a0a1-d50fd3db6d3c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:14 devstack sudo[103317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:14 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:14 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.816s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Deleted volume successfully.
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (eeceda03-cc00-4c1c-8aab-0d4a0468a2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba5e8d3-793c-4739-a530-8a1ed6b05183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ba5e8d3-793c-4739-a530-8a1ed6b05183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945164919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd978e4-66f6-424e-bd97-24db68b2e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:15Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d82592-ec61-4272-b60b-c178a1de0912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92d82592-ec61-4272-b60b-c178a1de0912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15984ca7-4fe3-4a25-b10c-cbbaa6432351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15984ca7-4fe3-4a25-b10c-cbbaa6432351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd978e4-66f6-424e-bd97-24db68b2e2be', 'volume_name': 'volume-2cd978e4-66f6-424e-bd97-24db68b2e2be', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b444fc70-3da5-4d0a-81cf-936fd2824e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b444fc70-3da5-4d0a-81cf-936fd2824e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282706f7-41f6-41e9-80be-191aa6cc48a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:14 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Volume 2cd978e4-66f6-424e-bd97-24db68b2e2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd978e4-66f6-424e-bd97-24db68b2e2be', 'volume_size': 1}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1945164919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd978e4-66f6-424e-bd97-24db68b2e2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:15Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Creating volume 2cd978e4-66f6-424e-bd97-24db68b2e2be {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:15 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ce01861b-7d31-4104-80d4-3e19dc3883c5 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-b18d3ef2-dd2b-4172-8e96-2b4929f9719e-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:15 devstack sudo[103320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be 1073741824
Jul 07 22:52:15 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:16 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be 1073741824" returned: 0 in 1.013s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:16 devstack sudo[103327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be
Jul 07 22:52:16 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:16 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282706f7-41f6-41e9-80be-191aa6cc48a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd978e4-66f6-424e-bd97-24db68b2e2be', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a086e9c-6b97-4fcd-a855-543c4be14c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:16 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Volume volume-2cd978e4-66f6-424e-bd97-24db68b2e2be (2cd978e4-66f6-424e-bd97-24db68b2e2be): created successfully
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a086e9c-6b97-4fcd-a855-543c4be14c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (eeceda03-cc00-4c1c-8aab-0d4a0468a2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-89e52ab1-294c-4c2e-a8bd-e58aa818ea69 tempest-ProjectReaderTests-1258239376 None] Created volume successfully.
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-2cd978e4-66f6-424e-bd97-24db68b2e2be-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "cinder-2cd978e4-66f6-424e-bd97-24db68b2e2be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-quobyte-2cd978e4-66f6-424e-bd97-24db68b2e2be" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-2cd978e4-66f6-424e-bd97-24db68b2e2be" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1bc011-e603-42da-9b1b-169c6c229497]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:18 devstack sudo[103330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be
Jul 07 22:52:18 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:19 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be" returned: 0 in 0.860s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:19 devstack sudo[103335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be
Jul 07 22:52:19 devstack sudo[103335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:19 devstack sudo[103335]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2cd978e4-66f6-424e-bd97-24db68b2e2be" returned: 0 in 0.747s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-2cd978e4-66f6-424e-bd97-24db68b2e2be" released by "delete_volume" :: held 1.673s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Created reservations ['75af420c-27a7-4604-a038-3c5461b46c60', '923139ee-8f20-4a02-9d0a-ca2bb70e054e', '7b4a26e8-9ca9-481a-803a-0a5c705d31cc', '8da44bd3-20c8-43c8-b965-6ccd6ebf2f2c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (2b3f51f3-87ba-42dc-a15d-20e849c94858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6828d8d-37d0-4d0e-b920-0723a70c32ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6828d8d-37d0-4d0e-b920-0723a70c32ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1296389808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa6931b-058b-4b76-bfdc-b1ff7ebfc936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:20Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f036d5e8-e88b-416a-a658-41f687bc7e98),volume_type_id=f036d5e8-e88b-416a-a658-41f687bc7e98)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6c53bb-155e-430d-8c4a-a5207e32f4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6c53bb-155e-430d-8c4a-a5207e32f4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6bfea5-f711-4922-96c5-a0885619e9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c6bfea5-f711-4922-96c5-a0885619e9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa6931b-058b-4b76-bfdc-b1ff7ebfc936', 'volume_name': 'volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f16aa-3772-4120-bd5d-325ea60fd734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b10f16aa-3772-4120-bd5d-325ea60fd734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db124bf9-8dfc-4820-b108-87b5e6c71fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume afa6931b-058b-4b76-bfdc-b1ff7ebfc936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936', 'volume_size': 1}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1296389808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa6931b-058b-4b76-bfdc-b1ff7ebfc936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:20Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f036d5e8-e88b-416a-a658-41f687bc7e98),volume_type_id=f036d5e8-e88b-416a-a658-41f687bc7e98)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Creating volume afa6931b-058b-4b76-bfdc-b1ff7ebfc936 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:20 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:20 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 1073741824
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:20 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:20 devstack sudo[103340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:20 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (c367cb86-0714-4559-beec-bde53315f9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836e0188-a239-4f39-ac19-88d79e27fc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (836e0188-a239-4f39-ac19-88d79e27fc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132300812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:20Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb0de96-e9c4-4557-bb29-ce10ea836f7c),volume_type_id=7bb0de96-e9c4-4557-bb29-ce10ea836f7c)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8434df33-14df-464e-a3db-a539cc9181b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8434df33-14df-464e-a3db-a539cc9181b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f853bab-8165-4207-a508-69af04a39893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f853bab-8165-4207-a508-69af04a39893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b', 'volume_name': 'volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9030fc6-f973-491f-90f4-17b7ac5f6d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9030fc6-f973-491f-90f4-17b7ac5f6d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bc74f6-df5b-4bea-a557-f59d6b44d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b', 'volume_size': 1}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (702d364f-4d73-41a1-87fc-d9f729ef1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b55a539-8dfe-4540-a53a-19036ddfd375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b55a539-8dfe-4540-a53a-19036ddfd375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133521287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ff907a-d1ba-4918-ac2f-64562b2e54b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:21Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab70a21-c6c9-48c4-95ee-546260c7856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab70a21-c6c9-48c4-95ee-546260c7856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c29c566-90b4-4dae-b192-ab94823cc614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c29c566-90b4-4dae-b192-ab94823cc614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ff907a-d1ba-4918-ac2f-64562b2e54b6', 'volume_name': 'volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fa7607-b338-409a-b373-1f8e776153ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11fa7607-b338-409a-b373-1f8e776153ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672508c-3c52-4f20-989a-5132a580f101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Volume e6ff907a-d1ba-4918-ac2f-64562b2e54b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6', 'volume_size': 1}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.975s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Deleted volume successfully.
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ec2ebeca-b960-4829-80a8-337a7fb6732e tempest-ProjectReaderTests-1258239376 None] Lock "cinder-2cd978e4-66f6-424e-bd97-24db68b2e2be-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:21 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (a2e0fdb4-e7d0-4009-8d5f-3b02f5b67f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798df399-1e1b-4d88-afe4-26fcd642061e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 1073741824" returned: 0 in 1.238s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798df399-1e1b-4d88-afe4-26fcd642061e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1975371488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81381435-d79f-49a3-a0bb-8a97fc36f05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:21Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1006fb07-3064-4cac-95ad-90bd1d665b0f),volume_type_id=1006fb07-3064-4cac-95ad-90bd1d665b0f)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa576b5-b280-4ae0-8339-64910e9b2b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8aa576b5-b280-4ae0-8339-64910e9b2b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776cf2cd-ee5e-41b6-82a1-788b0cfb8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:21 devstack sudo[103347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936
Jul 07 22:52:21 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776cf2cd-ee5e-41b6-82a1-788b0cfb8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81381435-d79f-49a3-a0bb-8a97fc36f05d', 'volume_name': 'volume-81381435-d79f-49a3-a0bb-8a97fc36f05d', 'volume_size': 1, 'image_id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390796977', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5334ccad7cc643b280e66fcb757ae207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741a9700>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cc6b80-42ee-4326-ad2d-89d2b3f9d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cc6b80-42ee-4326-ad2d-89d2b3f9d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832ea1bd-b4c0-4697-9417-f042ea226019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:21 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume 81381435-d79f-49a3-a0bb-8a97fc36f05d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81381435-d79f-49a3-a0bb-8a97fc36f05d', 'volume_size': 1, 'image_id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390796977', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5334ccad7cc643b280e66fcb757ae207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741a9700>}
Jul 07 22:52:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Trying to clone 81381435-d79f-49a3-a0bb-8a97fc36f05d from image b8ce098c-6b37-4595-877b-40a0cdc9d47e at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 22:52:22 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" returned: 0 in 0.686s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-132300812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:20Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7bb0de96-e9c4-4557-bb29-ce10ea836f7c),volume_type_id=7bb0de96-e9c4-4557-bb29-ce10ea836f7c)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Creating volume e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:22 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:22 devstack sudo[103350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b 1073741824
Jul 07 22:52:22 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db124bf9-8dfc-4820-b108-87b5e6c71fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e8606-1af9-4834-a6c1-e1c0fd2f7e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 (afa6931b-058b-4b76-bfdc-b1ff7ebfc936): created successfully
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15e8606-1af9-4834-a6c1-e1c0fd2f7e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (2b3f51f3-87ba-42dc-a15d-20e849c94858) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5a6bd352-47c2-4cf4-b428-277f579c6647 tempest-TestInstancesWithCinderVolumes-658572626 None] Created volume successfully.
Jul 07 22:52:22 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b 1073741824" returned: 0 in 0.845s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:22 devstack sudo[103356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b
Jul 07 22:52:22 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:23 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" returned: 0 in 0.656s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.532s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1133521287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ff907a-d1ba-4918-ac2f-64562b2e54b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:21Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Creating volume e6ff907a-d1ba-4918-ac2f-64562b2e54b6 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:23 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:23 devstack sudo[103359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 1073741824
Jul 07 22:52:23 devstack sudo[103359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bc74f6-df5b-4bea-a557-f59d6b44d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77ba7a7-3250-4272-8717-cd5875d563ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b (e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b): created successfully
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77ba7a7-3250-4272-8717-cd5875d563ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (c367cb86-0714-4559-beec-bde53315f9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-25e9972d-df2c-406c-b218-b40ff25b6aa1 tempest-TestInstancesWithCinderVolumes-658572626 None] Created volume successfully.
Jul 07 22:52:24 devstack sudo[103359]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 1073741824" returned: 0 in 0.891s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:24 devstack sudo[103365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6
Jul 07 22:52:24 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:24 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD, size 20.69 MB, duration 3.12 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 22:52:24 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Image download 20.69 MB at 6.62 MB/s
Jul 07 22:52:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[84139ac6-61c4-419b-b59a-eda0b3976b67]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:24 devstack sudo[103367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD
Jul 07 22:52:24 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:25 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" returned: 0 in 0.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d672508c-3c52-4f20-989a-5132a580f101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdf1430-b330-476d-b0e3-055607819de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Volume volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 (e6ff907a-d1ba-4918-ac2f-64562b2e54b6): created successfully
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fdf1430-b330-476d-b0e3-055607819de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (702d364f-4d73-41a1-87fc-d9f729ef1c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-58db3cf2-0bd0-4361-b048-b846c656cef5 tempest-ProjectReaderTests-1258239376 None] Created volume successfully.
Jul 07 22:52:25 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD" returned: 0 in 0.732s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Temporary image b8ce098c-6b37-4595-877b-40a0cdc9d47e is fetched for user 0edd90a48160471989394c15d16fbe93. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206a514-5369-4d24-93d3-874b5dbc5882]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:25 devstack sudo[103373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD
Jul 07 22:52:25 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-e6ff907a-d1ba-4918-ac2f-64562b2e54b6-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-e6ff907a-d1ba-4918-ac2f-64562b2e54b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-quobyte-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:26 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD" returned: 0 in 0.742s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1975371488',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81381435-d79f-49a3-a0bb-8a97fc36f05d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5334ccad7cc643b280e66fcb757ae207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:21Z,use_quota=True,user_id='0edd90a48160471989394c15d16fbe93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1006fb07-3064-4cac-95ad-90bd1d665b0f),volume_type_id=1006fb07-3064-4cac-95ad-90bd1d665b0f)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Creating volume 81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:26 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" acquired by "delete_volume" :: waited 0.035s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:26 devstack sudo[103379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1073741824
Jul 07 22:52:26 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd1fba-cb55-4b73-aebc-09856f582738]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:26 devstack sudo[103381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6
Jul 07 22:52:26 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:27 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1073741824" returned: 0 in 0.906s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:27 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" returned: 0 in 0.891s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:27 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6
Jul 07 22:52:27 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:27 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:27 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:27 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-e6ff907a-d1ba-4918-ac2f-64562b2e54b6" released by "delete_volume" :: held 1.617s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:28 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Created reservations ['203a57bf-3220-4ced-a085-87afb96b0d1d', '098062f4-acae-4ed2-b62a-71a01281c75b', 'efdeb048-eaab-4ed9-b2e0-68ba9a628e7c', '19959249-ddca-426b-8acc-6c4790991954'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 0.728s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] <== create_volume: return (1689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Attempting download of b8ce098c-6b37-4595-877b-40a0cdc9d47e ((None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}])) to volume 81381435-d79f-49a3-a0bb-8a97fc36f05d. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239647d-5eb8-4e9d-9995-47ecccb5dc3d]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:28 devstack sudo[103395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:28 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:28 devstack sudo[103396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb
Jul 07 22:52:28 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:28 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.726s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Deleted volume successfully.
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c5421e98-e251-424d-82ec-afd4d9302d77 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-e6ff907a-d1ba-4918-ac2f-64562b2e54b6-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:28 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:29 devstack sudo[103402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb
Jul 07 22:52:29 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (417c7bc7-cfd1-4d17-922f-34f2f2d5945e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fe164-0788-40d6-b654-08f84f98045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4fe164-0788-40d6-b654-08f84f98045c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118584848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:29Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962af97-159e-4751-93c2-6aeb76cb4316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962af97-159e-4751-93c2-6aeb76cb4316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ed4f07-f497-4c78-81fb-93cbd324151c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ed4f07-f497-4c78-81fb-93cbd324151c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89', 'volume_name': 'volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ec276-1428-4cd9-b6b9-29f0c2bb1411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (557ec276-1428-4cd9-b6b9-29f0c2bb1411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b24bb1f-cc00-4bb7-be7c-25b0d27958e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Volume 0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89', 'volume_size': 1}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1118584848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e583ec201de4451926bd92d0ef08ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:52:29Z,use_quota=True,user_id='7e64892292474a5f99ce590e97a3c357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Creating volume 0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:52:29 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:29 devstack sudo[103404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 1073741824
Jul 07 22:52:29 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:29 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb" returned: 1 in 0.805s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8ce098c-6b37-4595-877b-40a0cdc9d47e_hlyhtcqb' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efd6e3-8526-4e36-8813-c5597906f0fb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:29 devstack sudo[103409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD
Jul 07 22:52:29 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:30 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 1073741824" returned: 0 in 0.929s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:30 devstack sudo[103414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89
Jul 07 22:52:30 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:30 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD" returned: 0 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] b8ce098c-6b37-4595-877b-40a0cdc9d47e was qcow2, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:30 devstack sudo[103419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:30 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:30 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" returned: 0 in 0.701s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b24bb1f-cc00-4bb7-be7c-25b0d27958e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce17055-9bde-4ba9-a892-ff2819e04e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:30 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Volume volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 (0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89): created successfully
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce17055-9bde-4ba9-a892-ff2819e04e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:30 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Flow 'volume_create_manager' (417c7bc7-cfd1-4d17-922f-34f2f2d5945e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0b81c403-4bcd-4c64-a334-28447c9ec49b tempest-ProjectReaderTests-1258239376 None] Created volume successfully.
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "cinder-quobyte-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ece3dcb-91d2-4904-8714-1f2fcf6afaf8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:31 devstack sudo[103429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89
Jul 07 22:52:31 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:32 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" returned: 0 in 0.933s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:32 devstack sudo[103434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89
Jul 07 22:52:32 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:32 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 2.073s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8ce098c-6b37-4595-877b-40a0cdc9d47e_zwxi572udevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:52:32 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Converted 112.00 MB image at 53.99 MB/s
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:32 devstack sudo[103436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1G
Jul 07 22:52:32 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:32 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" returned: 0 in 0.678s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-quobyte-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89" released by "delete_volume" :: held 1.657s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Created reservations ['42c5fd72-045a-4f45-a6f0-d5246fb66285', '2356487f-b319-4f74-bfc5-539077872a23', '29f9b6ab-239b-4aeb-9ced-07f8896a2fb0', 'b5ee3077-ec37-46d6-997a-85131d8ea8f1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:33 devstack sudo[103439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:33 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:33 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d 1G" returned: 0 in 0.749s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cecd30-44e3-4cab-b888-87f33aebf10b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:33 devstack sudo[103444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:33 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:33 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.725s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:33 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Deleted volume successfully.
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cefb22cb-b3bf-4f66-bfa6-190fd81e5522 tempest-ProjectReaderTests-1258239376 None] Lock "cinder-0a5e6dc1-3ce3-4e41-ab82-61d03e90cf89-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:33 devstack sudo[103447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:52:33 devstack sudo[103447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:34 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 0.948s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:34 devstack sudo[103451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:34 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:34 devstack sudo[103447]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.668s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:52:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:52:35 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 1 in 0.915s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Downloaded image b8ce098c-6b37-4595-877b-40a0cdc9d47e ((None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}])) to volume 81381435-d79f-49a3-a0bb-8a97fc36f05d successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Temporary image b8ce098c-6b37-4595-877b-40a0cdc9d47e for user 0edd90a48160471989394c15d16fbe93 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Marking volume 81381435-d79f-49a3-a0bb-8a97fc36f05d as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Copying metadata from image b8ce098c-6b37-4595-877b-40a0cdc9d47e to 81381435-d79f-49a3-a0bb-8a97fc36f05d. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Creating volume glance metadata for volume 81381435-d79f-49a3-a0bb-8a97fc36f05d backed by image b8ce098c-6b37-4595-877b-40a0cdc9d47e with: {'image_id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'image_name': 'tempest-scenario-img--390796977', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (832ea1bd-b4c0-4697-9417-f042ea226019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81381435-d79f-49a3-a0bb-8a97fc36f05d', 'volume_size': 1, 'image_id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--390796977', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5334ccad7cc643b280e66fcb757ae207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8ce098c-6b37-4595-877b-40a0cdc9d47e', 'created_at': datetime.datetime(2026, 7, 7, 20, 52, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 20, 52, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8ce098c-6b37-4595-877b-40a0cdc9d47e/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741a9700>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff876c-1def-4512-9c07-8b8c383b0bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:52:35 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Volume volume-81381435-d79f-49a3-a0bb-8a97fc36f05d (81381435-d79f-49a3-a0bb-8a97fc36f05d): created successfully
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45ff876c-1def-4512-9c07-8b8c383b0bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:52:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Flow 'volume_create_manager' (a2e0fdb4-e7d0-4009-8d5f-3b02f5b67f85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:52:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d6d32653-af16-43c5-a22d-6038b309bce4 tempest-TestInstancesWithCinderVolumes-658572626 None] Created volume successfully.
Jul 07 22:52:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:52:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:52:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce809b4b-7abe-41e8-b2cb-ceb50fe67aa2]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:52:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:43 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:43 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:44 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:52:44 devstack sudo[103479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:52:44 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:52:45 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root
Jul 07 22:52:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 1 in 0.801s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:52:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:52:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.647s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:52:45 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-81381435-d79f-49a3-a0bb-8a97fc36f05d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd32b77d6-6334-499a-b9ee-f64b64927b89', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:52:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-aec02ed2-a7c6-4093-a739-16987383fb99 req-4f8c613b-e81a-47fb-b7e9-da11a37a5818 tempest-TestInstancesWithCinderVolumes-658572626 None] attachment_update completed successfully.
Jul 07 22:52:55 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=46,cinder:DELETE=8,cinder:SELECT=43,cinder:INSERT=20 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=62,cinder:DELETE=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc3508-85eb-41bf-a81d-26ba4287902f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:22 devstack sudo[104079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936
Jul 07 22:53:22 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:23 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" returned: 0 in 0.822s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.841s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ca42e49-0440-4f8c-afa9-b4de39414a3e', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:53:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-67e586dc-3fef-4a7d-9952-853f7d986c6b req-2cb13a5e-4474-4ec1-b030-ed821379d7fb tempest-TestInstancesWithCinderVolumes-658572626 None] attachment_update completed successfully.
Jul 07 22:53:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[129391b4-1c14-4cf2-8b89-1c3ca0e74910]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:31 devstack sudo[104104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b
Jul 07 22:53:31 devstack sudo[104104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:31 devstack sudo[104104]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" returned: 0 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '787009b5-961c-4614-bef1-aee9d6609d9b', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:53:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c504d246-5b99-4d19-8bdf-502b1fbcbd54 req-24a0dfa6-3315-4471-a4c5-d93db8cf50dd tempest-TestInstancesWithCinderVolumes-658572626 None] attachment_update completed successfully.
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:33 devstack sudo[104111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:53:33 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:34 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.675s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:53:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:53:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:53:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-9c90c26c-b13c-4caf-aea1-1d8165df3c36 req-23ac3282-af6b-4585-bab6-6afc0cc448d1 tempest-TestInstancesWithCinderVolumes-658572626 None] Terminate volume connection completed successfully.
Jul 07 22:53:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-9c90c26c-b13c-4caf-aea1-1d8165df3c36 req-23ac3282-af6b-4585-bab6-6afc0cc448d1 tempest-TestInstancesWithCinderVolumes-658572626 None] Deleting attachment 7ca42e49-0440-4f8c-afa9-b4de39414a3e. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:53:41 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-afa6931b-058b-4b76-bfdc-b1ff7ebfc936-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-afa6931b-058b-4b76-bfdc-b1ff7ebfc936-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-quobyte-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ee959-f3cb-4561-9a7b-a93f104fa39b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:42 devstack sudo[104158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936
Jul 07 22:53:42 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:43 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" returned: 0 in 0.924s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:43 devstack sudo[104163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936
Jul 07 22:53:43 devstack sudo[104163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:44 devstack sudo[104163]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" returned: 0 in 0.847s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-afa6931b-058b-4b76-bfdc-b1ff7ebfc936" released by "delete_volume" :: held 1.817s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:44 devstack cinder-volume[88152]: WARNING cinder.quota [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189515568-2127961475 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189515568-2127961475, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:53:44 devstack cinder-volume[88152]: WARNING cinder.quota [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189515568-2127961475 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-189515568-2127961475, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Created reservations ['ce64b868-fc00-497c-bf4a-528d6f4c098d', 'c66b3060-9c37-423a-91c2-ed89e839f6a6', 'f10eec81-54cc-42f6-b3d6-830bcb7da9cd', '85f70f0b-378e-4529-8a4e-2570e19d00c5'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:44 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:53:44 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:45 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.750s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:45 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:45 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deleted volume successfully.
Jul 07 22:53:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6962afea-e24b-426d-b292-48b51dd422c3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-afa6931b-058b-4b76-bfdc-b1ff7ebfc936-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-70f70599-c835-48ee-b0ff-cca88141fa4d req-de9b0c11-20f4-4ceb-aa11-6dc48e9f5415 tempest-TestInstancesWithCinderVolumes-658572626 None] Terminate volume connection completed successfully.
Jul 07 22:53:47 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-70f70599-c835-48ee-b0ff-cca88141fa4d req-de9b0c11-20f4-4ceb-aa11-6dc48e9f5415 tempest-TestInstancesWithCinderVolumes-658572626 None] Deleting attachment 787009b5-961c-4614-bef1-aee9d6609d9b. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-quobyte-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" acquired by "delete_volume" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[195d889a-7fae-46b2-a315-d25e48277f33]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:49 devstack sudo[104194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b
Jul 07 22:53:49 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:50 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:50 devstack sudo[104199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b
Jul 07 22:53:50 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:50 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" returned: 0 in 0.711s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b" released by "delete_volume" :: held 1.547s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:51 devstack cinder-volume[88152]: WARNING cinder.quota [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-58123825-2092706460 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-58123825-2092706460, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:53:51 devstack cinder-volume[88152]: WARNING cinder.quota [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-58123825-2092706460 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-58123825-2092706460, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Created reservations ['0f80409f-3df4-4b7c-a7a4-932838508254', 'a95dac02-d9b4-4e03-8611-770729382563', '903f87bd-f378-40be-83e3-f795bde202d5', '395e91be-1545-46f0-9ae8-c5558384a381'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:51 devstack sudo[104204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:53:51 devstack sudo[104204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:53:51 devstack sudo[104204]: pam_unix(sudo:session): session closed for user root
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:53:51 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Deleted volume successfully.
Jul 07 22:53:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a6e43917-7f78-4ed1-b271-d51c0f99e9e3 tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-e0cb4bcc-d6d5-4b6b-869b-249dea6bdf4b-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:53:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-a60aac28-4468-4a52-87b1-f7f7fcff4bdf req-f650112c-58ba-497c-aadc-9e79a016aecf tempest-TestInstancesWithCinderVolumes-658572626 None] Terminate volume connection completed successfully.
Jul 07 22:53:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-a60aac28-4468-4a52-87b1-f7f7fcff4bdf req-f650112c-58ba-497c-aadc-9e79a016aecf tempest-TestInstancesWithCinderVolumes-658572626 None] Deleting attachment d32b77d6-6334-499a-b9ee-f64b64927b89. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-81381435-d79f-49a3-a0bb-8a97fc36f05d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-81381435-d79f-49a3-a0bb-8a97fc36f05d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "cinder-quobyte-81381435-d79f-49a3-a0bb-8a97fc36f05d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-81381435-d79f-49a3-a0bb-8a97fc36f05d" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c1bae2c-e20b-40ac-a19c-e681086e011b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:53:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:53:59 devstack sudo[104237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:53:59 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:00 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:00 devstack sudo[104241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:54:00 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:01 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 1 in 0.793s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:01 devstack sudo[104246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d
Jul 07 22:54:01 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:01 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-81381435-d79f-49a3-a0bb-8a97fc36f05d" returned: 0 in 0.656s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-quobyte-81381435-d79f-49a3-a0bb-8a97fc36f05d" released by "delete_volume" :: held 2.333s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:01 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092093299-1011920715 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092093299-1011920715, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:54:01 devstack cinder-volume[88152]: WARNING cinder.quota [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092093299-1011920715 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1092093299-1011920715, it is now deprecated. Please use the default quota class for default quota.
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Created reservations ['9443f790-685d-4cd3-a398-b482fb2062e8', 'c80b56f0-b036-49c0-ab89-37c9ed6af80a', '40d954a3-a4f5-42a7-b581-14ad83216a1b', '8f0827e4-cfbf-4692-8d50-5d3d4d56e00a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:01 devstack sudo[104249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:54:01 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:02 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:02 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:02 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Deleted volume successfully.
Jul 07 22:54:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8592701f-14aa-4af6-a38c-c9db83cee6cb tempest-TestInstancesWithCinderVolumes-658572626 None] Lock "cinder-81381435-d79f-49a3-a0bb-8a97fc36f05d-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:54:11 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=24,cinder:SELECT=19,cinder:INSERT=4,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:54:12 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=27,cinder:UPDATE=26,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:54:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:54:33 devstack sudo[104299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:54:33 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:54:34 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root
Jul 07 22:54:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.819s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:54:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:54:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:54:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:54:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:55:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:55:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Flow 'volume_create_manager' (fefc41db-0259-4435-a20c-206dc382c8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062bbcf3-686a-4278-82ad-57ae52f68d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062bbcf3-686a-4278-82ad-57ae52f68d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2144680715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826370bf-a48e-4647-a433-e97f4168ea31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6950343bcc412b9e732db3d70f589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:13Z,use_quota=True,user_id='36e1ca06de584341ab9363c27461da96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c324ed0-f976-4f82-996b-45c25cc167b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c324ed0-f976-4f82-996b-45c25cc167b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7deee7-4b36-47e6-93b4-2f72a24106d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e7deee7-4b36-47e6-93b4-2f72a24106d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '826370bf-a48e-4647-a433-e97f4168ea31', 'volume_name': 'volume-826370bf-a48e-4647-a433-e97f4168ea31', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b92f490-9884-440e-b44b-4d1038cb0eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b92f490-9884-440e-b44b-4d1038cb0eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369b53b-1c15-44ec-85cf-e565c21173a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:13 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Volume 826370bf-a48e-4647-a433-e97f4168ea31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-826370bf-a48e-4647-a433-e97f4168ea31', 'volume_size': 1}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2144680715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=826370bf-a48e-4647-a433-e97f4168ea31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d6950343bcc412b9e732db3d70f589e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:55:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:55:13Z,use_quota=True,user_id='36e1ca06de584341ab9363c27461da96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Creating volume 826370bf-a48e-4647-a433-e97f4168ea31 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:55:13 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:55:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:13 devstack sudo[104820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 1073741824
Jul 07 22:55:13 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:14 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 1073741824" returned: 0 in 0.854s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:14 devstack sudo[104827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31
Jul 07 22:55:14 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:14 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9369b53b-1c15-44ec-85cf-e565c21173a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-826370bf-a48e-4647-a433-e97f4168ea31', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b86dd3-2971-4cf9-bfca-ec6e3bfc85f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:55:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Volume volume-826370bf-a48e-4647-a433-e97f4168ea31 (826370bf-a48e-4647-a433-e97f4168ea31): created successfully
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5b86dd3-2971-4cf9-bfca-ec6e3bfc85f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:55:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Flow 'volume_create_manager' (fefc41db-0259-4435-a20c-206dc382c8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:55:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c8fe81d2-6468-4dc1-8aee-80ba3173a6f2 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Created volume successfully.
Jul 07 22:55:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a36750-ce89-413d-904b-4871c1ef9e2e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:18 devstack sudo[104842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31
Jul 07 22:55:18 devstack sudo[104842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:19 devstack sudo[104842]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31" returned: 0 in 0.789s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.810s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:19 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-826370bf-a48e-4647-a433-e97f4168ea31', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f073101f-2b54-4e55-8adf-d17748ba2939', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:55:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-1e99ea0e-4553-49b5-9f58-c14b93ccc4c7 req-63c4570a-0938-47e2-8729-6915e8567b61 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] attachment_update completed successfully.
Jul 07 22:55:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-b3d14bfa-ecf1-49d5-909c-6428fb22f6b7 req-cb1a9330-2a0f-4791-a1b1-5f14fba3c360 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Terminate volume connection completed successfully.
Jul 07 22:55:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-b3d14bfa-ecf1-49d5-909c-6428fb22f6b7 req-cb1a9330-2a0f-4791-a1b1-5f14fba3c360 tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Deleting attachment f073101f-2b54-4e55-8adf-d17748ba2939. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "cinder-826370bf-a48e-4647-a433-e97f4168ea31-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "cinder-826370bf-a48e-4647-a433-e97f4168ea31-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "cinder-quobyte-826370bf-a48e-4647-a433-e97f4168ea31" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "cinder-quobyte-826370bf-a48e-4647-a433-e97f4168ea31" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cd4199-a884-4d8e-a745-c6affc694b09]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:55:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:27 devstack sudo[105345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31
Jul 07 22:55:27 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:28 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31" returned: 0 in 0.805s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:28 devstack sudo[105350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31
Jul 07 22:55:28 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:29 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-826370bf-a48e-4647-a433-e97f4168ea31" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "cinder-quobyte-826370bf-a48e-4647-a433-e97f4168ea31" released by "delete_volume" :: held 1.539s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Created reservations ['35fd8431-00da-4a71-be5b-8b431e7b1684', 'edc0ff61-d4b8-40c7-b606-586dfd364f7a', '5feb9c3a-8467-40c7-83ed-aabca5e7abcb', '2a794e4f-25d9-4fad-a614-ded66412ce01'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:29 devstack sudo[105353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:55:29 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:30 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:30 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Deleted volume successfully.
Jul 07 22:55:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d2cd91a2-0209-4d22-8667-9378ccd307ec tempest-TestServerVolumeAttachScenarioOldVersion-1044297520 None] Lock "cinder-826370bf-a48e-4647-a433-e97f4168ea31-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:55:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:55:33 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:55:33 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:55:34 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Jul 07 22:55:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:55:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:55:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:55:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:55:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:55:39 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:55:40 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=11,cinder:SELECT=11,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Flow 'volume_create_manager' (0f9ee1f3-9f0b-455a-9ab5-94ce116f5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc97a0b-e824-4aca-babb-938720c1a49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc97a0b-e824-4aca-babb-938720c1a49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1326677189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc2ebb-0ae8-45c2-9acd-b0a4c497298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d812ecb5e7a846129cf2bec4f784ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:08Z,use_quota=True,user_id='b355d4fb5b454e35a8d476b686fb6e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95804e6a-b400-43a3-85c3-21d51fb946dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95804e6a-b400-43a3-85c3-21d51fb946dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4115ae3f-9f0a-4562-ab12-c641ff700625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4115ae3f-9f0a-4562-ab12-c641ff700625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cc2ebb-0ae8-45c2-9acd-b0a4c497298b', 'volume_name': 'volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60734d3-fecb-4c2c-8d70-2d156e897e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60734d3-fecb-4c2c-8d70-2d156e897e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6b4be-4493-47f8-9ec5-05f2511ba560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Volume 62cc2ebb-0ae8-45c2-9acd-b0a4c497298b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b', 'volume_size': 1}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1326677189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc2ebb-0ae8-45c2-9acd-b0a4c497298b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d812ecb5e7a846129cf2bec4f784ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:56:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:56:08Z,use_quota=True,user_id='b355d4fb5b454e35a8d476b686fb6e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Creating volume 62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:56:08 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:56:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:08 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b 1073741824
Jul 07 22:56:08 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:09 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b 1073741824" returned: 0 in 0.924s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:09 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:56:09 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:09 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc6b4be-4493-47f8-9ec5-05f2511ba560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80047622-a27b-4fee-8b26-c0035ba35881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:56:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Volume volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b (62cc2ebb-0ae8-45c2-9acd-b0a4c497298b): created successfully
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80047622-a27b-4fee-8b26-c0035ba35881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:56:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Flow 'volume_create_manager' (0f9ee1f3-9f0b-455a-9ab5-94ce116f5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:56:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b7ddbae9-78e9-4529-a7e0-3511b93eacc7 tempest-TestStampPattern-2072083361 None] Created volume successfully.
Jul 07 22:56:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:56:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:33 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:56:33 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:34 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.669s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:56:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:56:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:56:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:56:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:56:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:56:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ba997-b04a-4db6-91ef-31570f932c20]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:56:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:56:53 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:56:53 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:56:54 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jul 07 22:56:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.759s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:56:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:56:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8c15865-5f37-4a96-80e1-568153437276', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:56:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c75f72e2-6060-4570-b989-f1d141a51f91 req-8929b68b-d2ea-4533-bb15-27c639c3b989 tempest-TestStampPattern-2072083361 None] attachment_update completed successfully.
Jul 07 22:57:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-efc846e2-3553-4baf-bcdd-12ed05130af9 req-f32dfb7c-b1d8-45c6-b64d-37b8f6662431 tempest-TestStampPattern-2072083361 None] Terminate volume connection completed successfully.
Jul 07 22:57:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-efc846e2-3553-4baf-bcdd-12ed05130af9 req-f32dfb7c-b1d8-45c6-b64d-37b8f6662431 tempest-TestStampPattern-2072083361 None] Deleting attachment c8c15865-5f37-4a96-80e1-568153437276. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:57:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Creating offline snapshot 5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf of volume 62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:57:05 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2c7385-3581-46cb-b509-1d219f78af6f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:05 devstack sudo[106021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:57:05 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:06 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:06 devstack sudo[106037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf 1G
Jul 07 22:57:06 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:07 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf 1G" returned: 0 in 0.866s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:07 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:57:07 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:07 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:07 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf is being set with open permissions: ugo+rw
Jul 07 22:57:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:07 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:57:07 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:08 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.602s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:08 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info
Jul 07 22:57:08 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:08 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info" returned: 0 in 0.635s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:09 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info is being set with open permissions: ugo+rw
Jul 07 22:57:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:09 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info
Jul 07 22:57:09 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:09 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.info" returned: 0 in 0.618s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.277s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:09 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ca86f961-77ec-4763-a93e-04c9978fbf90 tempest-TestStampPattern-2072083361 None] Create snapshot completed successfully
Jul 07 22:57:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:57:19 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=5,cinder:SELECT=12,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Flow 'volume_create_manager' (09159a68-8d77-4ec0-b294-994326ff2029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983a9e34-d79d-4329-8394-969846c51897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983a9e34-d79d-4329-8394-969846c51897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1302362635',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e69e94-f01d-4366-84c4-f7847c0e58e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d812ecb5e7a846129cf2bec4f784ff44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:57:20Z,use_quota=True,user_id='b355d4fb5b454e35a8d476b686fb6e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fa94b1-df9e-48f1-912c-ad058066b80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fa94b1-df9e-48f1-912c-ad058066b80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b676e5c2-2f3e-4fe5-bd19-b37435fbd21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b676e5c2-2f3e-4fe5-bd19-b37435fbd21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4e69e94-f01d-4366-84c4-f7847c0e58e1', 'volume_name': 'volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1', 'volume_size': 1, 'snapshot_id': '5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d362bc44-94b4-4c8e-a870-02ccd11c7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d362bc44-94b4-4c8e-a870-02ccd11c7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5caa39-5f29-40d0-b892-19883760f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Volume c4e69e94-f01d-4366-84c4-f7847c0e58e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1', 'volume_size': 1, 'snapshot_id': '5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf'}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-c4e69e94-f01d-4366-84c4-f7847c0e58e1" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-c4e69e94-f01d-4366-84c4-f7847c0e58e1" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Creating volume c4e69e94-f01d-4366-84c4-f7847c0e58e1 from snapshot 5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] snapshot: 5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf, volume: c4e69e94-f01d-4366-84c4-f7847c0e58e1,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5db70f-b4ef-49df-8967-1105b49e02af]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:20 devstack sudo[106125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:57:20 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:21 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.833s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d196f0f-1dcb-4f66-88bc-34c22c0c7d6c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:21 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:57:21 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:22 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.834s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:22 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:57:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:22 devstack sudo[106138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1
Jul 07 22:57:22 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:27 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1" returned: 0 in 4.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aebd22-8bfe-4839-885a-bb67ef8f2cb6]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:57:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:27 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:57:27 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:28 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 1.121s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:28 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b, size 1024.00 MB, duration 4.82 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:57:28 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Converted 1024.00 MB image at 212.48 MB/s
Jul 07 22:57:28 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 is being set with open permissions: ugo+rw
Jul 07 22:57:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:28 devstack sudo[106157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1
Jul 07 22:57:28 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:29 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1" returned: 0 in 0.770s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" released by "_copy_volume_from_snapshot" :: held 8.493s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-c4e69e94-f01d-4366-84c4-f7847c0e58e1" released by "_create_volume_from_snapshot" :: held 8.526s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.547s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b5caa39-5f29-40d0-b892-19883760f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1', 'volume_size': 1, 'snapshot_id': '5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92a2a66-0ec3-448e-b0e1-4cf7dd00dd42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:57:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Volume volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 (c4e69e94-f01d-4366-84c4-f7847c0e58e1): created successfully
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b92a2a66-0ec3-448e-b0e1-4cf7dd00dd42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:57:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Flow 'volume_create_manager' (09159a68-8d77-4ec0-b294-994326ff2029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:57:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-20c56baf-4d05-47d8-8895-453cd91d3297 tempest-TestStampPattern-2072083361 None] Created volume successfully.
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:57:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:57:33 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:57:33 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:57:34 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Jul 07 22:57:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.813s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:57:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:57:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:57:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:57:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:57:39 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:57:39 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0759b92a-33c9-4de0-a2be-495da537869e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:04 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1
Jul 07 22:58:04 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:05 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1" returned: 0 in 0.798s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.817s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5', 'name': 'volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '997d3377-3180-4ffe-9a23-65362ad44a0d', 'enforce_multipath': True} {{(pid=88152) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 07 22:58:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-c838a91c-621a-49a1-9a47-2a074a915857 req-78cdf214-9937-49f6-9371-3e46ed73bcb8 tempest-TestStampPattern-2072083361 None] attachment_update completed successfully.
Jul 07 22:58:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [req-186cfed0-b32a-45c6-a326-6bede35c9ad9 req-95ec8bfb-86c5-4c40-936e-9ae48fc7eb12 tempest-TestStampPattern-2072083361 None] Terminate volume connection completed successfully.
Jul 07 22:58:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [req-186cfed0-b32a-45c6-a326-6bede35c9ad9 req-95ec8bfb-86c5-4c40-936e-9ae48fc7eb12 tempest-TestStampPattern-2072083361 None] Deleting attachment 997d3377-3180-4ffe-9a23-65362ad44a0d. {{(pid=88152) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 07 22:58:21 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:21 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-c4e69e94-f01d-4366-84c4-f7847c0e58e1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "cinder-c4e69e94-f01d-4366-84c4-f7847c0e58e1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf25cd1-ddbb-459c-83d2-f3a91e8b2744]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:22 devstack sudo[106779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1
Jul 07 22:58:22 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:22 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1" returned: 0 in 0.795s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:22 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1
Jul 07 22:58:22 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:23 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c4e69e94-f01d-4366-84c4-f7847c0e58e1" returned: 0 in 0.642s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-c4e69e94-f01d-4366-84c4-f7847c0e58e1" released by "delete_volume" :: held 1.478s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Created reservations ['31b7a294-a47e-4212-966a-40495ab54b70', 'ee7d4109-b8a4-4624-8b4f-856f85c596ef', '50888c21-10e3-4b4b-a7b4-c011dec19c09', '1789529b-b576-4464-8f3a-02357ad021db'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:23 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:58:23 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:24 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.654s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:58:24 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Deleted volume successfully.
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3ab7fd60-b12a-438b-a737-ab5f49037ac3 tempest-TestStampPattern-2072083361 None] Lock "cinder-c4e69e94-f01d-4366-84c4-f7847c0e58e1-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Deleting offline snapshot 5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf of volume 62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] snapshot_file for this snap is: volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff6def-6fe0-4ba4-a450-4fa7e1864f25]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:24 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:58:24 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:25 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.754s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:58:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[530a1f49-f050-47fe-97ea-e2fc8ad2f9e2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:25 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:58:25 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:26 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.754s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:26 devstack sudo[106802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:58:26 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:26 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.735s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:26 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf
Jul 07 22:58:26 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:27 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b.5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf" released by "_delete_snapshot" :: held 3.017s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" released by "delete_snapshot" :: held 3.042s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:27 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Created reservations ['1922b013-fe6b-4172-86a9-fb8b5121e6bd', '3bb356f6-5129-4d04-aade-efe4ed68c8fb', '6b188811-e9ac-4dd2-99b1-fad3859e9b85', '273a61fb-2cbd-497a-b996-6c801019dcbb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:58:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Delete snapshot completed successfully.
Jul 07 22:58:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-21a83857-2782-46fb-9a94-440c72542f73 tempest-TestStampPattern-2072083361 None] Lock "cinder-5a7c202e-9b78-45d0-8ceb-5dd2cfd184cf-delete_snapshot" released by "delete_snapshot" :: held 3.194s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:33 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:58:33 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:34 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.666s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:58:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:58:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:58:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:58:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "cinder-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Acquiring lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:58:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:58:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11f14d1-efbd-4e19-9c27-c680a3545179]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:58:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:36 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:58:36 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:36 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.743s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:36 devstack sudo[106846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b
Jul 07 22:58:36 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:37 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" returned: 0 in 0.609s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "cinder-quobyte-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b" released by "delete_volume" :: held 1.407s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Created reservations ['7fcc033a-cf29-453a-b1d2-bb9db2c26db3', 'ff31db32-4ec6-4b61-b978-0f953bec6126', 'e2165156-f2be-405b-a555-cdeb57c271bb', '27206a1e-b744-4302-8a3a-5cd4b1597422'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:58:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:58:37 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:58:37 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:58:38 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Jul 07 22:58:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.630s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:58:38 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:58:38 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Deleted volume successfully.
Jul 07 22:58:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c690a85c-c21b-4620-a5be-fceafcd28b11 tempest-TestStampPattern-2072083361 None] Lock "cinder-62cc2ebb-0ae8-45c2-9acd-b0a4c497298b-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:58:47 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:58:48 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:59:02 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Flow 'volume_create_manager' (38f45a66-59e2-4ab2-9f35-09269a9cbd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b8b84f-c451-48b7-ba77-200d219065db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27b8b84f-c451-48b7-ba77-200d219065db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-871596860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604afd7-fdac-469a-8308-24aa0463ff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35eb1d733af54b9ba87fbb982e0990a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:59:20Z,use_quota=True,user_id='0fb83e65441040088966396b18c526a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1415e758-d8b5-49b2-8fce-c3c06f7626cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1415e758-d8b5-49b2-8fce-c3c06f7626cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc086c4f-2fe4-4b12-a5e8-780466402eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc086c4f-2fe4-4b12-a5e8-780466402eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8604afd7-fdac-469a-8308-24aa0463ff97', 'volume_name': 'volume-8604afd7-fdac-469a-8308-24aa0463ff97', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd6a1f0-1f0b-4340-8961-f902ee6eb218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd6a1f0-1f0b-4340-8961-f902ee6eb218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707089fd-a3c7-47a7-a81d-042d8f1d1d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Volume 8604afd7-fdac-469a-8308-24aa0463ff97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8604afd7-fdac-469a-8308-24aa0463ff97', 'volume_size': 1}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:59:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-871596860',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8604afd7-fdac-469a-8308-24aa0463ff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35eb1d733af54b9ba87fbb982e0990a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:59:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:59:20Z,use_quota=True,user_id='0fb83e65441040088966396b18c526a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Creating volume 8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:59:20 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 22:59:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:20 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 1073741824
Jul 07 22:59:20 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:21 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 1073741824" returned: 0 in 0.937s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:21 devstack sudo[106913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:21 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:21 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.655s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707089fd-a3c7-47a7-a81d-042d8f1d1d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8604afd7-fdac-469a-8308-24aa0463ff97', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87002caf-b3b5-4377-8082-8fe2bd793e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:21 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Volume volume-8604afd7-fdac-469a-8308-24aa0463ff97 (8604afd7-fdac-469a-8308-24aa0463ff97): created successfully
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87002caf-b3b5-4377-8082-8fe2bd793e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Flow 'volume_create_manager' (38f45a66-59e2-4ab2-9f35-09269a9cbd97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1b7eaeed-a769-47a9-b570-4e19dfa71146 tempest-SnapshotDependencyTests-1787444165 None] Created volume successfully.
Jul 07 22:59:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Creating offline snapshot 87c01f10-b415-45ad-892e-296337fefb19 of volume 8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 22:59:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ab93a1-4837-46b6-93b0-3ff71f26be9c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:22 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:22 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:23 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.785s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:23 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 1G
Jul 07 22:59:23 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:24 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 1G" returned: 0 in 0.838s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8604afd7-fdac-469a-8308-24aa0463ff97 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:24 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8604afd7-fdac-469a-8308-24aa0463ff97 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:24 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:25 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8604afd7-fdac-469a-8308-24aa0463ff97 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:25 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 is being set with open permissions: ugo+rw
Jul 07 22:59:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:25 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:25 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:25 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.728s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:25 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info
Jul 07 22:59:25 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:26 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info" returned: 0 in 0.697s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:26 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info is being set with open permissions: ugo+rw
Jul 07 22:59:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:26 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info
Jul 07 22:59:26 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:27 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.info" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.684s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a42c946a-4a42-491a-8457-877108cea431 tempest-SnapshotDependencyTests-1787444165 None] Create snapshot completed successfully
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Flow 'volume_create_manager' (b3763d3e-7e62-44e2-b915-c0741660fe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a917c182-1da8-4051-bd71-fa9c8e2fbfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a917c182-1da8-4051-bd71-fa9c8e2fbfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T20:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5324601b-36a3-4649-9361-c3ae77cb378f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35eb1d733af54b9ba87fbb982e0990a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=87c01f10-b415-45ad-892e-296337fefb19,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T20:59:28Z,use_quota=True,user_id='0fb83e65441040088966396b18c526a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088e29a9-d30f-42e4-9ab4-7d931d9366ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088e29a9-d30f-42e4-9ab4-7d931d9366ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475a2b-72d6-4508-9693-2582b9aee4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e475a2b-72d6-4508-9693-2582b9aee4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5324601b-36a3-4649-9361-c3ae77cb378f', 'volume_name': 'volume-5324601b-36a3-4649-9361-c3ae77cb378f', 'volume_size': 1, 'snapshot_id': '87c01f10-b415-45ad-892e-296337fefb19'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bab504-bc7f-4e4c-9349-0678e0660fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9bab504-bc7f-4e4c-9349-0678e0660fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ffea1d-ab40-4fe4-bf34-2e92b855c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:28 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Volume 5324601b-36a3-4649-9361-c3ae77cb378f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5324601b-36a3-4649-9361-c3ae77cb378f', 'volume_size': 1, 'snapshot_id': '87c01f10-b415-45ad-892e-296337fefb19'}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19-5324601b-36a3-4649-9361-c3ae77cb378f" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19-5324601b-36a3-4649-9361-c3ae77cb378f" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Creating volume 5324601b-36a3-4649-9361-c3ae77cb378f from snapshot 87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] snapshot: 87c01f10-b415-45ad-892e-296337fefb19, volume: 5324601b-36a3-4649-9361-c3ae77cb378f,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[703ee3db-cf23-46e8-ada3-9e1d968847cd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:28 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:28 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:29 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.791s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8604afd7-fdac-469a-8308-24aa0463ff97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[af38d752-ad0f-4f88-9ec7-a7116b04259e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:29 devstack sudo[106946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:29 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:30 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:30 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 22:59:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:30 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f
Jul 07 22:59:30 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:33 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:59:33 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:34 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f" returned: 0 in 4.477s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8005925-ef43-40c1-8fcf-85f20dbffa50]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:34 devstack sudo[106966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:34 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:34 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.983s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 22:59:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 22:59:35 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:35 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97, size 1024.00 MB, duration 4.48 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 22:59:35 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Converted 1024.00 MB image at 228.66 MB/s
Jul 07 22:59:35 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f is being set with open permissions: ugo+rw
Jul 07 22:59:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:35 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f
Jul 07 22:59:35 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:36 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f" returned: 0 in 0.590s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" released by "_copy_volume_from_snapshot" :: held 7.601s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19-5324601b-36a3-4649-9361-c3ae77cb378f" released by "_create_volume_from_snapshot" :: held 7.634s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.650s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ffea1d-ab40-4fe4-bf34-2e92b855c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5324601b-36a3-4649-9361-c3ae77cb378f', 'volume_size': 1, 'snapshot_id': '87c01f10-b415-45ad-892e-296337fefb19'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc202c8-ef9e-4d93-8e79-c47b4cb6c004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 22:59:36 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Volume volume-5324601b-36a3-4649-9361-c3ae77cb378f (5324601b-36a3-4649-9361-c3ae77cb378f): created successfully
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc202c8-ef9e-4d93-8e79-c47b4cb6c004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 22:59:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Flow 'volume_create_manager' (b3763d3e-7e62-44e2-b915-c0741660fe42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 22:59:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d4355016-227b-4aa8-be46-0b355f05002d tempest-SnapshotDependencyTests-1787444165 None] Created volume successfully.
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-87c01f10-b415-45ad-892e-296337fefb19-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-87c01f10-b415-45ad-892e-296337fefb19-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Deleting offline snapshot 87c01f10-b415-45ad-892e-296337fefb19 of volume 8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] snapshot_file for this snap is: volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9f86f4-b4a4-442f-b3bd-da4db8a4d572]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:37 devstack sudo[106976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:37 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:37 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8604afd7-fdac-469a-8308-24aa0463ff97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[536ee150-eb37-44af-a23e-35d2e28d06fe]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:37 devstack sudo[106981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:37 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:38 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:38 devstack sudo[106986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:38 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:39 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.736s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:39 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19
Jul 07 22:59:39 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:40 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97.87c01f10-b415-45ad-892e-296337fefb19" returned: 0 in 0.634s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-87c01f10-b415-45ad-892e-296337fefb19" released by "_delete_snapshot" :: held 2.943s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" released by "delete_snapshot" :: held 2.963s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Created reservations ['a12d10d3-ebd8-4b60-8b29-8de0ac2d0833', 'f6f9988e-2df7-4cb4-ab33-2f17119ab6c3', '27fb8ade-a48d-4ad8-845f-92a623dbeaa2', 'c14876b7-5779-4df5-a85d-c3b250e6c0f7'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:59:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Delete snapshot completed successfully.
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a7c54fb-a0fc-474c-b395-5f5629d2c137 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-87c01f10-b415-45ad-892e-296337fefb19-delete_snapshot" released by "delete_snapshot" :: held 3.108s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-8604afd7-fdac-469a-8308-24aa0463ff97-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-8604afd7-fdac-469a-8308-24aa0463ff97-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce65c1a-f381-456e-add6-5978a324d265]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:40 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:40 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:41 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.828s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:41 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97
Jul 07 22:59:41 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:41 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-8604afd7-fdac-469a-8308-24aa0463ff97" returned: 0 in 0.645s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-8604afd7-fdac-469a-8308-24aa0463ff97" released by "delete_volume" :: held 1.535s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Created reservations ['bdd49895-21ff-4ea5-be3a-8ec15e1aec61', 'd8997b98-c7cd-4ff6-988c-2e9422b996fa', '1553fed1-23a6-4b41-ac31-3f4a6c35ea92', '36c96f1b-ab68-43bb-897d-e942911fc008'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:42 devstack sudo[107008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:59:42 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-5324601b-36a3-4649-9361-c3ae77cb378f-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-5324601b-36a3-4649-9361-c3ae77cb378f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e550ca3-45c8-4edc-80cd-bfce063a3df7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:42 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.656s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:59:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Deleted volume successfully.
Jul 07 22:59:42 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a18a0e5f-78a2-470e-b1fd-46844838dca4 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-8604afd7-fdac-469a-8308-24aa0463ff97-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:42 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f
Jul 07 22:59:42 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:43 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f" returned: 0 in 0.701s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:43 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f
Jul 07 22:59:43 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:43 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5324601b-36a3-4649-9361-c3ae77cb378f" returned: 0 in 0.600s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-quobyte-5324601b-36a3-4649-9361-c3ae77cb378f" released by "delete_volume" :: held 1.340s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:43 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Created reservations ['912e55d0-bbe2-4e96-b89a-03cf6059a603', '88503c62-9703-490b-8bae-6e7c640f08b8', 'dea5dbd4-222e-48af-8246-6dfa7b50e8c4', 'be253e32-5b41-4407-9f4e-b96563c499df'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 22:59:44 devstack sudo[107019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 22:59:44 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 22:59:44 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.653s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 22:59:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Deleted volume successfully.
Jul 07 22:59:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-724b927b-ba4c-422c-bb7c-b6cf866aedf9 tempest-SnapshotDependencyTests-1787444165 None] Lock "cinder-5324601b-36a3-4649-9361-c3ae77cb378f-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 22:59:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=22,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 22:59:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Flow 'volume_create_manager' (e0a220b1-9f1a-4447-993c-ca14bce3b534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a088f-a74d-4fd9-8c63-32bf1a68fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23a088f-a74d-4fd9-8c63-32bf1a68fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7266d3b-42b7-43a8-a0a3-8a922606d351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b591e1327e64a2d916ab35042dd03c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='08483bacd6f84a21bc99cde82e80cf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b913e01-b9a1-48c0-a57e-c72c85696c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b913e01-b9a1-48c0-a57e-c72c85696c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d407986-f2fa-4fa1-bf05-a15106983522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d407986-f2fa-4fa1-bf05-a15106983522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7266d3b-42b7-43a8-a0a3-8a922606d351', 'volume_name': 'volume-c7266d3b-42b7-43a8-a0a3-8a922606d351', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865c7f5e-5e0b-4cda-821c-95ee01fddaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865c7f5e-5e0b-4cda-821c-95ee01fddaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c67fc-cf4d-4697-9e15-73af0cbe5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Volume c7266d3b-42b7-43a8-a0a3-8a922606d351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7266d3b-42b7-43a8-a0a3-8a922606d351', 'volume_size': 1}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7266d3b-42b7-43a8-a0a3-8a922606d351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b591e1327e64a2d916ab35042dd03c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='08483bacd6f84a21bc99cde82e80cf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Creating volume c7266d3b-42b7-43a8-a0a3-8a922606d351 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:04 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:04 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 1073741824
Jul 07 23:00:04 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (ec2f7676-36cb-41e4-96e6-14a8ae0892d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624091a9-23a7-4d28-95af-e72876178f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624091a9-23a7-4d28-95af-e72876178f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967755150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0d733b-82fb-402d-b5c9-8a57e98d09ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9e7f51-ad9d-4271-92e1-108aed7354fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e9e7f51-ad9d-4271-92e1-108aed7354fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b303998-55b6-44c4-8fa3-ad864ca3012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b303998-55b6-44c4-8fa3-ad864ca3012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0d733b-82fb-402d-b5c9-8a57e98d09ae', 'volume_name': 'volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9116bea7-cc55-4b3b-b5ed-fbe63fd13026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9116bea7-cc55-4b3b-b5ed-fbe63fd13026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81990bf1-c019-4dea-b94d-4be38fbcc0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Volume 3d0d733b-82fb-402d-b5c9-8a57e98d09ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae', 'volume_size': 1}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (a35a5774-9d9c-498a-aa8b-8511507e1863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7e3d43-b5e3-4a7c-8424-0e170ea3257a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be7e3d43-b5e3-4a7c-8424-0e170ea3257a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398832279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23539cbe-4eeb-4aa8-8c0b-d147c8cb6db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23539cbe-4eeb-4aa8-8c0b-d147c8cb6db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0b7117-79fe-4eb5-8c01-da9c7772fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da0b7117-79fe-4eb5-8c01-da9c7772fce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47', 'volume_name': 'volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4d8182-96bc-4900-b01e-711189944b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4d8182-96bc-4900-b01e-711189944b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7add23b-c994-4e8a-ac4f-f2dc1b4516e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Volume 818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47', 'volume_size': 1}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (bc1cb990-4c8c-487e-980a-b435abb2ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19711ce-69a3-4a5f-af39-3b5dfa3a386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c19711ce-69a3-4a5f-af39-3b5dfa3a386c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604527467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277bf367-d30f-4a5f-92e7-7591476fe12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cf7410-f5ff-4b7e-b182-2817d993691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45cf7410-f5ff-4b7e-b182-2817d993691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e301194a-5a00-4eee-84ce-1a0943322a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e301194a-5a00-4eee-84ce-1a0943322a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '277bf367-d30f-4a5f-92e7-7591476fe12f', 'volume_name': 'volume-277bf367-d30f-4a5f-92e7-7591476fe12f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f68c452-2cac-4dc6-a9ed-7be8ddadcd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f68c452-2cac-4dc6-a9ed-7be8ddadcd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d076e84-775d-43c5-b350-89c585b30fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume 277bf367-d30f-4a5f-92e7-7591476fe12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-277bf367-d30f-4a5f-92e7-7591476fe12f', 'volume_size': 1}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (4226a601-8474-41bf-9814-adb94f9335c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f0a473-3dcc-4230-bebd-aa88ed29c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:04 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f0a473-3dcc-4230-bebd-aa88ed29c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752691963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e302abc2-0f90-41da-b98e-56c2b20d34b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537cc684-166c-4a6c-adfd-c5fd433a0064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537cc684-166c-4a6c-adfd-c5fd433a0064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a282e1-8e77-4874-ad3a-b5c5fa94fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a282e1-8e77-4874-ad3a-b5c5fa94fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e302abc2-0f90-41da-b98e-56c2b20d34b4', 'volume_name': 'volume-e302abc2-0f90-41da-b98e-56c2b20d34b4', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1856b68-d4cc-410b-aa6a-fc82f706c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1856b68-d4cc-410b-aa6a-fc82f706c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f74fe-2560-461d-9784-4e1ce4c0d025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Volume e302abc2-0f90-41da-b98e-56c2b20d34b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e302abc2-0f90-41da-b98e-56c2b20d34b4', 'volume_size': 1}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:05 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 1073741824" returned: 0 in 1.188s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:05 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351
Jul 07 23:00:05 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (f6c8150e-b1d8-423d-beb7-58b73f8f71ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fc307-f909-41bb-abb8-41486f638892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467fc307-f909-41bb-abb8-41486f638892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689872287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d232a2-811b-4e48-a5a9-06751bb3778d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece2f94-7e54-4f2b-aa50-a18822a36599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ece2f94-7e54-4f2b-aa50-a18822a36599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133516bf-deff-4216-a6d5-30a4b88486c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133516bf-deff-4216-a6d5-30a4b88486c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7d232a2-811b-4e48-a5a9-06751bb3778d', 'volume_name': 'volume-a7d232a2-811b-4e48-a5a9-06751bb3778d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab18e6d8-29a9-4c57-8cd2-f4fd0ea52ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab18e6d8-29a9-4c57-8cd2-f4fd0ea52ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacc8ab-c386-419c-8666-8b9228f2759d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Volume a7d232a2-811b-4e48-a5a9-06751bb3778d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7d232a2-811b-4e48-a5a9-06751bb3778d', 'volume_size': 1}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (cc9e2cdf-89d7-4b5b-a81f-f9b66281a3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b726ee5d-39d8-4b16-bb40-946b198b4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b726ee5d-39d8-4b16-bb40-946b198b4365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735995919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e00bfdd-090e-4f65-ba41-a2bff2224094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:06Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f98fe4b-fb6e-4c09-861c-34a45788a1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f98fe4b-fb6e-4c09-861c-34a45788a1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b145b-f636-467e-8b29-b629ac4f83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741b145b-f636-467e-8b29-b629ac4f83f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e00bfdd-090e-4f65-ba41-a2bff2224094', 'volume_name': 'volume-4e00bfdd-090e-4f65-ba41-a2bff2224094', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fddc8-ba06-4c1f-a157-fe9469cbe460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051fddc8-ba06-4c1f-a157-fe9469cbe460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216e6961-8c82-4e1f-b6d3-c3c6930d9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:05 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Volume 4e00bfdd-090e-4f65-ba41-a2bff2224094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e00bfdd-090e-4f65-ba41-a2bff2224094', 'volume_size': 1}
Jul 07 23:00:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:06 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351" returned: 0 in 0.841s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967755150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0d733b-82fb-402d-b5c9-8a57e98d09ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Creating volume 3d0d733b-82fb-402d-b5c9-8a57e98d09ae {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:06 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:06 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae 1073741824
Jul 07 23:00:06 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757c67fc-cf4d-4697-9e15-73af0cbe5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7266d3b-42b7-43a8-a0a3-8a922606d351', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad43b8ac-2366-426d-96f8-5929d1fefa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:06 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Volume volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 (c7266d3b-42b7-43a8-a0a3-8a922606d351): created successfully
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad43b8ac-2366-426d-96f8-5929d1fefa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:06 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Flow 'volume_create_manager' (e0a220b1-9f1a-4447-993c-ca14bce3b534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8add560b-2a80-4edf-b1a5-3e01a20b0b0e tempest-CinderUnicodeTest-1397564266 None] Created volume successfully.
Jul 07 23:00:07 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae 1073741824" returned: 0 in 0.948s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:07 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae
Jul 07 23:00:07 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Flow 'volume_create_manager' (abb6bcd4-35f9-47e6-a523-3675d3bb1b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3729e4b-cd77-4912-a35e-0cc666c61b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3729e4b-cd77-4912-a35e-0cc666c61b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1652238442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7e39db-7a13-4589-b551-e24e11db1851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b591e1327e64a2d916ab35042dd03c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:08Z,use_quota=True,user_id='08483bacd6f84a21bc99cde82e80cf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edef2c8-656a-492f-9d68-d678b6f46e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edef2c8-656a-492f-9d68-d678b6f46e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2246311-7913-4a3f-bbdc-bb9d254a1fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2246311-7913-4a3f-bbdc-bb9d254a1fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe7e39db-7a13-4589-b551-e24e11db1851', 'volume_name': 'volume-fe7e39db-7a13-4589-b551-e24e11db1851', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef16d5d-53ff-40ff-9bcb-7867a2586d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ef16d5d-53ff-40ff-9bcb-7867a2586d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404f444f-1b0c-4395-9c27-65e93f700ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:07 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Volume fe7e39db-7a13-4589-b551-e24e11db1851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe7e39db-7a13-4589-b551-e24e11db1851', 'volume_size': 1}
Jul 07 23:00:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:08 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" returned: 0 in 0.910s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.637s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1398832279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:04Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Creating volume 818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:08 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:08 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 1073741824
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81990bf1-c019-4dea-b94d-4be38fbcc0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:08 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5785ac-26ad-443b-8d1b-020b77dba58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Volume volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae (3d0d733b-82fb-402d-b5c9-8a57e98d09ae): created successfully
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5785ac-26ad-443b-8d1b-020b77dba58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (ec2f7676-36cb-41e4-96e6-14a8ae0892d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0a954328-5470-4352-9623-f97561fa181a tempest-CreateVolumesFromImageTest-105118002 None] Created volume successfully.
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Flow 'volume_create_manager' (0b682c5f-79d9-4d27-939a-040ddc2a4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffc583c-1843-41d0-866e-f103544f52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fffc583c-1843-41d0-866e-f103544f52f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845cba18-19bc-4dde-90ab-a199283d0f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0066941fb25d4e158d22f07be0c6430f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:09Z,use_quota=True,user_id='3bcdad5a5a7144ce92e7eae81ad898d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0367d7d-25a4-4b5f-b80c-838ed37ba37f),volume_type_id=a0367d7d-25a4-4b5f-b80c-838ed37ba37f)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49dca9b-a9a1-4e6b-baba-68d8a0b2e44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b49dca9b-a9a1-4e6b-baba-68d8a0b2e44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48ae0f-20b7-4c0b-ae7a-98f54c429aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:08 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b48ae0f-20b7-4c0b-ae7a-98f54c429aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '845cba18-19bc-4dde-90ab-a199283d0f85', 'volume_name': 'volume-845cba18-19bc-4dde-90ab-a199283d0f85', 'volume_size': 1, 'image_id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '330534d8ec6625b580b6563f7683be0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0066941fb25d4e158d22f07be0c6430f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b87bc7e31482c43bf899f0aa55710a27f57e58577ba90ed68623686ee754ce4cc8bda0ee0dc8ba979eec2ac2128f812d3bb1755d8e4a97ba33c6869d1823d75', 'id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2571dbc-bed4-46bf-b20e-764051a8b072/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741d22d0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706ce15a-ed73-4781-ae5f-e4e144877a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706ce15a-ed73-4781-ae5f-e4e144877a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a04cf4-d3cc-4de7-ade2-4fe82d1ee240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:09 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Volume 845cba18-19bc-4dde-90ab-a199283d0f85: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-845cba18-19bc-4dde-90ab-a199283d0f85', 'volume_size': 1, 'image_id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '330534d8ec6625b580b6563f7683be0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0066941fb25d4e158d22f07be0c6430f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b87bc7e31482c43bf899f0aa55710a27f57e58577ba90ed68623686ee754ce4cc8bda0ee0dc8ba979eec2ac2128f812d3bb1755d8e4a97ba33c6869d1823d75', 'id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2571dbc-bed4-46bf-b20e-764051a8b072/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741d22d0>}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Trying to clone 845cba18-19bc-4dde-90ab-a199283d0f85 from image f2571dbc-bed4-46bf-b20e-764051a8b072 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 23:00:09 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 1073741824" returned: 0 in 1.084s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:09 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47
Jul 07 23:00:09 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 23:00:09 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ff4b97-2aa3-4519-815a-1264e334ffe1]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:09 devstack sudo[107134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:09 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:09 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" returned: 0 in 0.690s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.078s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1604527467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=277bf367-d30f-4a5f-92e7-7591476fe12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume 277bf367-d30f-4a5f-92e7-7591476fe12f {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:09 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:09 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f 1073741824
Jul 07 23:00:09 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:10 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 0 in 0.793s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:10 devstack sudo[107141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:10 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:10 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f 1073741824" returned: 0 in 0.882s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:10 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 1 in 0.791s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:10 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Temporary image f2571dbc-bed4-46bf-b20e-764051a8b072 is fetched for user 3bcdad5a5a7144ce92e7eae81ad898d9. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7add23b-c994-4e8a-ac4f-f2dc1b4516e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42df88cd-ef38-41a7-a8cd-7c04892fd4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5e1b63-0454-4c03-a66b-840a43b8debe]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:11 devstack sudo[107149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:11 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:11 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Volume volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 (818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47): created successfully
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42df88cd-ef38-41a7-a8cd-7c04892fd4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:11 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (a35a5774-9d9c-498a-aa8b-8511507e1863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:12 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:12 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:12 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:12 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 1 in 0.708s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:14 devstack sudo[107160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f
Jul 07 23:00:14 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5f6a6b97-9d07-44f2-8f28-4a01bfba14c6 tempest-CreateVolumesFromImageTest-105118002 None] Created volume successfully.
Jul 07 23:00:15 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f" returned: 0 in 0.676s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (5349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.354s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.155s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752691963',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e302abc2-0f90-41da-b98e-56c2b20d34b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Creating volume e302abc2-0f90-41da-b98e-56c2b20d34b4 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:15 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 1073741824
Jul 07 23:00:15 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d076e84-775d-43c5-b350-89c585b30fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-277bf367-d30f-4a5f-92e7-7591476fe12f', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fbcf6b-0161-49e2-9c20-f904de9b8447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-277bf367-d30f-4a5f-92e7-7591476fe12f (277bf367-d30f-4a5f-92e7-7591476fe12f): created successfully
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fbcf6b-0161-49e2-9c20-f904de9b8447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (bc1cb990-4c8c-487e-980a-b435abb2ede7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a77b3f91-ad45-42e0-862b-e73ef9ce03a9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:16 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 1073741824" returned: 0 in 0.886s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:16 devstack sudo[107169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4
Jul 07 23:00:16 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:16 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4" returned: 0 in 0.711s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.295s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1689872287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7d232a2-811b-4e48-a5a9-06751bb3778d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:05Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Creating volume a7d232a2-811b-4e48-a5a9-06751bb3778d {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:16 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (145f74fe-2560-461d-9784-4e1ce4c0d025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e302abc2-0f90-41da-b98e-56c2b20d34b4', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:16 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d 1073741824
Jul 07 23:00:16 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e3b36-6aa1-4384-a6c8-34535af8d4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:16 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Volume volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 (e302abc2-0f90-41da-b98e-56c2b20d34b4): created successfully
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96e3b36-6aa1-4384-a6c8-34535af8d4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:16 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (4226a601-8474-41bf-9814-adb94f9335c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:16 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-db075183-731d-4f0c-b719-de9982285bb1 tempest-CreateVolumesFromImageTest-105118002 None] Created volume successfully.
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (bd0ec30b-b359-4ec6-8d15-b0a9ef7cd020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d034b1-40bd-4d34-a90f-5cf323f94b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31d034b1-40bd-4d34-a90f-5cf323f94b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211455448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:17Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8091278-5aa3-49e6-ac42-98418fa79721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8091278-5aa3-49e6-ac42-98418fa79721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e89189-3f18-4e9d-8920-e8eb7c8ccaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e89189-3f18-4e9d-8920-e8eb7c8ccaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3', 'volume_name': 'volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10245e8f-6467-4d33-a92f-893b8062280b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10245e8f-6467-4d33-a92f-893b8062280b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7e3c8d-bbab-4ed9-8764-1995cf07eb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume 093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3', 'volume_size': 1}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (939ae95f-d089-4cb5-b67f-a365a89459b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c42c0a2-a2c5-4cf1-bc3d-1fab3ae25022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c42c0a2-a2c5-4cf1-bc3d-1fab3ae25022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729235528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66a70f8-8d97-4680-9837-5cba72d6551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:17Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206e9d94-76e2-4d41-98ad-1e942b1a4818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (206e9d94-76e2-4d41-98ad-1e942b1a4818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc93378-4f33-4370-8d4f-c5e09ab34246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc93378-4f33-4370-8d4f-c5e09ab34246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66a70f8-8d97-4680-9837-5cba72d6551b', 'volume_name': 'volume-e66a70f8-8d97-4680-9837-5cba72d6551b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a8b84-2c33-4ef7-b5bf-63c32539507c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216a8b84-2c33-4ef7-b5bf-63c32539507c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca13574-f979-4305-9b14-d08f9065454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume e66a70f8-8d97-4680-9837-5cba72d6551b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66a70f8-8d97-4680-9837-5cba72d6551b', 'volume_size': 1}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (421e103b-4391-4b6c-b260-a051b9226ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8b6f11-5531-46f9-80e2-ce3933fc2df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e8b6f11-5531-46f9-80e2-ce3933fc2df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501057062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549daba8-079d-4456-ad7a-205d8bc86de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:18Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33958bb-f8e6-4cbe-b6d0-d00222c31257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c33958bb-f8e6-4cbe-b6d0-d00222c31257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d71055-513f-4b00-a90c-69268b8ae6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d71055-513f-4b00-a90c-69268b8ae6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549daba8-079d-4456-ad7a-205d8bc86de7', 'volume_name': 'volume-549daba8-079d-4456-ad7a-205d8bc86de7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d26faf0-860c-4fa0-928a-6b33a0a4f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d26faf0-860c-4fa0-928a-6b33a0a4f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29107f84-b36a-46cc-8f38-6a28df6f4e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume 549daba8-079d-4456-ad7a-205d8bc86de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549daba8-079d-4456-ad7a-205d8bc86de7', 'volume_size': 1}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d 1073741824" returned: 0 in 1.059s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:17 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d
Jul 07 23:00:17 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (e36a0611-248c-4645-8c2c-ef684c656aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a3a426-f870-42d3-a814-2f4aa3c9fdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a3a426-f870-42d3-a814-2f4aa3c9fdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43411998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11b36b-86f2-408d-ac91-52c831f4adc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:18Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b855701-7934-41b2-8a7f-3f7ce8fb690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b855701-7934-41b2-8a7f-3f7ce8fb690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fffd796-1f0a-4338-b6ea-1461a42c24dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fffd796-1f0a-4338-b6ea-1461a42c24dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c11b36b-86f2-408d-ac91-52c831f4adc0', 'volume_name': 'volume-0c11b36b-86f2-408d-ac91-52c831f4adc0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28a632e-c3ac-4cab-a570-284217fc5362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28a632e-c3ac-4cab-a570-284217fc5362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ab8eb2-9f44-49d1-9c62-051b506cd1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume 0c11b36b-86f2-408d-ac91-52c831f4adc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c11b36b-86f2-408d-ac91-52c831f4adc0', 'volume_size': 1}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (3b661b45-20c7-4fa8-a925-a1b1e8eb04fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d2ea8b-d3f7-4587-92a1-4eb2ab6db0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d2ea8b-d3f7-4587-92a1-4eb2ab6db0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242548780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6822dfc7-8fc9-4979-80ad-a8045804c6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:19Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052215c0-df3d-4c67-9f4d-22093af97879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (052215c0-df3d-4c67-9f4d-22093af97879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836be488-3beb-453c-a5b3-fd61e011059b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (836be488-3beb-453c-a5b3-fd61e011059b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6822dfc7-8fc9-4979-80ad-a8045804c6d2', 'volume_name': 'volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ec3f7b-ee53-4cba-9440-4735b47af3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ec3f7b-ee53-4cba-9440-4735b47af3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f516f5df-3d79-4469-9238-0ecbd976c016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume 6822dfc7-8fc9-4979-80ad-a8045804c6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2', 'volume_size': 1}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.842s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735995919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e00bfdd-090e-4f65-ba41-a2bff2224094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf5f81c92a76451ab52ab6a3fee4c6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:06Z,use_quota=True,user_id='942cd104c8c74b6cbf01e0913f529b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Creating volume 4e00bfdd-090e-4f65-ba41-a2bff2224094 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:18 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:18 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 1073741824
Jul 07 23:00:18 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dacc8ab-c386-419c-8666-8b9228f2759d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7d232a2-811b-4e48-a5a9-06751bb3778d', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc45f8-5949-4a69-8f66-c69d55c31097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:18 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Volume volume-a7d232a2-811b-4e48-a5a9-06751bb3778d (a7d232a2-811b-4e48-a5a9-06751bb3778d): created successfully
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56bc45f8-5949-4a69-8f66-c69d55c31097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:18 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (f6c8150e-b1d8-423d-beb7-58b73f8f71ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:18 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-77922474-6735-4cfa-8a15-abcf57cf15fe tempest-CreateVolumesFromImageTest-105118002 None] Created volume successfully.
Jul 07 23:00:19 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 1073741824" returned: 0 in 0.823s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:19 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094
Jul 07 23:00:19 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:20 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094" returned: 0 in 0.657s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.529s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1652238442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe7e39db-7a13-4589-b551-e24e11db1851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b591e1327e64a2d916ab35042dd03c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:08Z,use_quota=True,user_id='08483bacd6f84a21bc99cde82e80cf74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Creating volume fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:20 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216e6961-8c82-4e1f-b6d3-c3c6930d9b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e00bfdd-090e-4f65-ba41-a2bff2224094', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7606b687-58a1-4696-8fa9-fa2ee4c5a8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:20 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 1073741824
Jul 07 23:00:20 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:20 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Volume volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 (4e00bfdd-090e-4f65-ba41-a2bff2224094): created successfully
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7606b687-58a1-4696-8fa9-fa2ee4c5a8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Flow 'volume_create_manager' (cc9e2cdf-89d7-4b5b-a81f-f9b66281a3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7e162d49-d8ef-4ce9-a75f-f1493b2da5d2 tempest-CreateVolumesFromImageTest-105118002 None] Created volume successfully.
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-4e00bfdd-090e-4f65-ba41-a2bff2224094-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-4e00bfdd-090e-4f65-ba41-a2bff2224094-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-quobyte-4e00bfdd-090e-4f65-ba41-a2bff2224094" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-4e00bfdd-090e-4f65-ba41-a2bff2224094" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9ef411-538c-454f-9703-f72b07d15e67]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:21 devstack sudo[107196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094
Jul 07 23:00:21 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:21 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 1073741824" returned: 0 in 0.918s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:21 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851
Jul 07 23:00:21 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:21 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:21 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094
Jul 07 23:00:21 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:21 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851" returned: 0 in 0.696s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.971s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=845cba18-19bc-4dde-90ab-a199283d0f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0066941fb25d4e158d22f07be0c6430f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:09Z,use_quota=True,user_id='3bcdad5a5a7144ce92e7eae81ad898d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0367d7d-25a4-4b5f-b80c-838ed37ba37f),volume_type_id=a0367d7d-25a4-4b5f-b80c-838ed37ba37f)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Creating volume 845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:21 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:22 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1073741824
Jul 07 23:00:22 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404f444f-1b0c-4395-9c27-65e93f700ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe7e39db-7a13-4589-b551-e24e11db1851', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f048d1-b606-4915-8bdc-7196062f37ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Volume volume-fe7e39db-7a13-4589-b551-e24e11db1851 (fe7e39db-7a13-4589-b551-e24e11db1851): created successfully
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f048d1-b606-4915-8bdc-7196062f37ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Flow 'volume_create_manager' (abb6bcd4-35f9-47e6-a523-3675d3bb1b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1145f995-18f8-468d-af8e-62ab949baa00 tempest-CinderUnicodeTest-1397564266 None] Created volume successfully.
Jul 07 23:00:22 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-4e00bfdd-090e-4f65-ba41-a2bff2224094" returned: 0 in 0.701s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-4e00bfdd-090e-4f65-ba41-a2bff2224094" released by "delete_volume" :: held 1.577s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Created reservations ['fbc36257-f214-4c40-a6e3-5ef8a1178af0', '9eddb0df-4d08-4242-9650-e5e63fd714cb', 'd11ceb08-6b79-47aa-a1c8-6093072ff7fa', '48eba525-1356-4fc8-9e74-16cd62dd097a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:22 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:22 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:23 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1073741824" returned: 0 in 1.035s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:23 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:23 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-a7d232a2-811b-4e48-a5a9-06751bb3778d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-a7d232a2-811b-4e48-a5a9-06751bb3778d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-quobyte-a7d232a2-811b-4e48-a5a9-06751bb3778d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-a7d232a2-811b-4e48-a5a9-06751bb3778d" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae555b0-f6ba-48ef-956d-2d84104ad916]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:23 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d
Jul 07 23:00:23 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:23 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.822s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Deleted volume successfully.
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f75786cf-ae73-42cc-8019-526056de7b14 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-4e00bfdd-090e-4f65-ba41-a2bff2224094-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:23 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.652s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211455448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:17Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume 093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:23 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:23 devstack sudo[107220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 1073741824
Jul 07 23:00:23 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Attempting download of f2571dbc-bed4-46bf-b20e-764051a8b072 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}])) to volume 845cba18-19bc-4dde-90ab-a199283d0f85. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[565b9530-066a-45fe-8ee2-2d775694b1c5]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:24 devstack sudo[107222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k
Jul 07 23:00:24 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:24 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d" returned: 0 in 0.878s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:24 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d
Jul 07 23:00:24 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:24 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k" returned: 0 in 0.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:24 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 1073741824" returned: 0 in 0.954s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:24 devstack sudo[107235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3
Jul 07 23:00:24 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:24 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k
Jul 07 23:00:24 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:24 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a7d232a2-811b-4e48-a5a9-06751bb3778d" returned: 0 in 0.734s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-a7d232a2-811b-4e48-a5a9-06751bb3778d" released by "delete_volume" :: held 1.658s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Created reservations ['56c3fec5-114f-43d0-b9ca-aad9c93eac8e', '11287f45-e5c7-43fe-8e80-d4c32e5dd638', 'fe28f29d-ab9d-450b-b573-367b5a194931', 'f0ec0a74-a176-43ee-914b-2192c34ea412'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:25 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:25 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:25 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-e302abc2-0f90-41da-b98e-56c2b20d34b4-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k" returned: 1 in 0.840s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f2571dbc-bed4-46bf-b20e-764051a8b072_r_ej172k' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5bf0a0-b3c7-4fbc-b994-2d8dda09ca3b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:25 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" returned: 0 in 0.787s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-e302abc2-0f90-41da-b98e-56c2b20d34b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.044s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1729235528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66a70f8-8d97-4680-9837-5cba72d6551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:17Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume e66a70f8-8d97-4680-9837-5cba72d6551b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:25 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:25 devstack sudo[107245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b 1073741824
Jul 07 23:00:25 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:25 devstack sudo[107244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:25 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b7e3c8d-bbab-4ed9-8764-1995cf07eb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957744-c038-4c6c-8fa1-d98cecc9f448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 (093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3): created successfully
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16957744-c038-4c6c-8fa1-d98cecc9f448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (bd0ec30b-b359-4ec6-8d15-b0a9ef7cd020) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-quobyte-e302abc2-0f90-41da-b98e-56c2b20d34b4" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ab7467fd-72e9-421f-8288-89f27766cf3e tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-e302abc2-0f90-41da-b98e-56c2b20d34b4" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0888a6e7-f3ba-47dc-84dc-2008cf130b92]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:25 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:25 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Deleted volume successfully.
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c619fd0f-2325-44f5-932e-b6599c172966 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-a7d232a2-811b-4e48-a5a9-06751bb3778d-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:26 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4
Jul 07 23:00:26 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:26 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:26 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD
Jul 07 23:00:26 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:26 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b 1073741824" returned: 0 in 1.122s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:26 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b
Jul 07 23:00:26 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:26 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4" returned: 0 in 0.958s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:26 devstack sudo[107265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4
Jul 07 23:00:26 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:27 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] f2571dbc-bed4-46bf-b20e-764051a8b072 was raw, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:27 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:27 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:27 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b" returned: 0 in 0.708s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.548s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-501057062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549daba8-079d-4456-ad7a-205d8bc86de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:18Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume 549daba8-079d-4456-ad7a-205d8bc86de7 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:27 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:27 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 1073741824
Jul 07 23:00:27 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca13574-f979-4305-9b14-d08f9065454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66a70f8-8d97-4680-9837-5cba72d6551b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fce27ea-a816-47e4-ad43-38feddb547a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:27 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e302abc2-0f90-41da-b98e-56c2b20d34b4" returned: 0 in 0.730s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-e66a70f8-8d97-4680-9837-5cba72d6551b (e66a70f8-8d97-4680-9837-5cba72d6551b): created successfully
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fce27ea-a816-47e4-ad43-38feddb547a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (939ae95f-d089-4cb5-b67f-a365a89459b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-e302abc2-0f90-41da-b98e-56c2b20d34b4" released by "delete_volume" :: held 1.779s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-aae86302-c076-434b-8c05-18867a2e7c93 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Created reservations ['4288ab72-cf2c-42cc-aed9-9238c42f9a9d', '236c6483-1633-4b9a-9bc2-9da1349445c8', '9d8487db-0964-4913-8d3d-5eff24ee48d8', '3caa719b-fd6d-4401-85da-da8e7b6b3170'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:27 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:27 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-quobyte-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c8d4d4-a432-4857-9bda-d3cddbed9483]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:28 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47
Jul 07 23:00:28 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:28 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 0 in 0.991s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f2571dbc-bed4-46bf-b20e-764051a8b072_dymny98ldevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:00:28 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:28 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1G
Jul 07 23:00:28 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:28 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 1073741824" returned: 0 in 1.089s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:28 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.871s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:28 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Deleted volume successfully.
Jul 07 23:00:28 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7
Jul 07 23:00:28 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-67913c15-0a38-4d0c-bc02-142063c6d1f9 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-e302abc2-0f90-41da-b98e-56c2b20d34b4-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:29 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" returned: 0 in 0.991s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:29 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47
Jul 07 23:00:29 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:29 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 1G" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[753ab92e-e204-4a36-b651-409a60adda7a]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:29 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:29 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:29 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7" returned: 0 in 0.699s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.955s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43411998',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11b36b-86f2-408d-ac91-52c831f4adc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:18Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume 0c11b36b-86f2-408d-ac91-52c831f4adc0 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:29 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29107f84-b36a-46cc-8f38-6a28df6f4e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549daba8-079d-4456-ad7a-205d8bc86de7', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:29 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 1073741824
Jul 07 23:00:29 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595729d9-d0ec-4ac5-a689-ac0a0d7104d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:29 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-549daba8-079d-4456-ad7a-205d8bc86de7 (549daba8-079d-4456-ad7a-205d8bc86de7): created successfully
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595729d9-d0ec-4ac5-a689-ac0a0d7104d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (421e103b-4391-4b6c-b260-a051b9226ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:29 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-acb39a76-d634-4415-8714-481747d67cce tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:29 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" returned: 0 in 0.726s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47" released by "delete_volume" :: held 1.769s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Created reservations ['3415a437-cfda-4d85-9784-6c9434bec55c', '374756f4-11a5-4eae-af37-30c9e7393dd6', '4b88a65f-3dfe-4536-9a67-a1d960a4541f', 'ff0fc485-7a55-4c61-b730-33157984303a'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:29 devstack sudo[107307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:29 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:30 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-3d0d733b-82fb-402d-b5c9-8a57e98d09ae-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-3d0d733b-82fb-402d-b5c9-8a57e98d09ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:30 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:30 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "cinder-quobyte-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" acquired by "delete_volume" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb653aa7-0c5f-43aa-a7ba-9a69d5bd6968]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:30 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 1073741824" returned: 0 in 1.082s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:30 devstack sudo[107318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0
Jul 07 23:00:30 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae
Jul 07 23:00:30 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:30 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:30 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Deleted volume successfully.
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3648a6a6-94b1-4b8a-872b-0167c1b21628 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-818e1a52-a6b9-44f4-a4e2-69bbf5bdbc47-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:30 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 1 in 0.909s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Downloaded image f2571dbc-bed4-46bf-b20e-764051a8b072 ((None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}])) to volume 845cba18-19bc-4dde-90ab-a199283d0f85 successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Temporary image f2571dbc-bed4-46bf-b20e-764051a8b072 for user 3bcdad5a5a7144ce92e7eae81ad898d9 is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 23:00:30 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Marking volume 845cba18-19bc-4dde-90ab-a199283d0f85 as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Copying metadata from image f2571dbc-bed4-46bf-b20e-764051a8b072 to 845cba18-19bc-4dde-90ab-a199283d0f85. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Creating volume glance metadata for volume 845cba18-19bc-4dde-90ab-a199283d0f85 backed by image f2571dbc-bed4-46bf-b20e-764051a8b072 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '330534d8ec6625b580b6563f7683be0e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a04cf4-d3cc-4de7-ade2-4fe82d1ee240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-845cba18-19bc-4dde-90ab-a199283d0f85', 'volume_size': 1, 'image_id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f2571dbc-bed4-46bf-b20e-764051a8b072', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '330534d8ec6625b580b6563f7683be0e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0066941fb25d4e158d22f07be0c6430f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3b87bc7e31482c43bf899f0aa55710a27f57e58577ba90ed68623686ee754ce4cc8bda0ee0dc8ba979eec2ac2128f812d3bb1755d8e4a97ba33c6869d1823d75', 'id': 'f2571dbc-bed4-46bf-b20e-764051a8b072', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f2571dbc-bed4-46bf-b20e-764051a8b072/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe741d22d0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67b5f7e-2a4f-4bf5-8224-36b499373422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:31 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Volume volume-845cba18-19bc-4dde-90ab-a199283d0f85 (845cba18-19bc-4dde-90ab-a199283d0f85): created successfully
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67b5f7e-2a4f-4bf5-8224-36b499373422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Flow 'volume_create_manager' (0b682c5f-79d9-4d27-939a-040ddc2a4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f5aacc7c-7956-4e41-a026-1a814eef7329 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Created volume successfully.
Jul 07 23:00:31 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0" returned: 0 in 0.724s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.419s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242548780',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6822dfc7-8fc9-4979-80ad-a8045804c6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5fbd380e81b40f09fec7699905eda53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:19Z,use_quota=True,user_id='b9c62d8ab4ef4630b97cef8a167a326c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Creating volume 6822dfc7-8fc9-4979-80ad-a8045804c6d2 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:31 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:31 devstack sudo[107329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 1073741824
Jul 07 23:00:31 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ab8eb2-9f44-49d1-9c62-051b506cd1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c11b36b-86f2-408d-ac91-52c831f4adc0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1789c1-4b15-4720-9a83-581b77744bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:31 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 (0c11b36b-86f2-408d-ac91-52c831f4adc0): created successfully
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de1789c1-4b15-4720-9a83-581b77744bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:31 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (e36a0611-248c-4645-8c2c-ef684c656aa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Acquiring lock "cinder-845cba18-19bc-4dde-90ab-a199283d0f85-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" returned: 0 in 0.942s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-28f81f48-7089-40c7-8078-464544efedd0 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "cinder-845cba18-19bc-4dde-90ab-a199283d0f85-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:31 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae
Jul 07 23:00:31 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Acquiring lock "cinder-quobyte-845cba18-19bc-4dde-90ab-a199283d0f85" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "cinder-quobyte-845cba18-19bc-4dde-90ab-a199283d0f85" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ca42fd-8d11-47c5-9d44-2419b4f1b92f]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:31 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:31 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:32 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" returned: 0 in 0.748s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-quobyte-3d0d733b-82fb-402d-b5c9-8a57e98d09ae" released by "delete_volume" :: held 1.739s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Created reservations ['56a0c2b3-0417-44bd-a14e-4f90c9e71c41', 'c3204e79-9cad-4a9f-bb3e-17f74e36214d', '6005c631-acd3-4b74-a380-cadbb2beff1c', 'dc7393ba-d780-4114-befa-cef56cb3b9e4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:32 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:32 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 1073741824" returned: 0 in 1.007s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:32 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:32 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:32 devstack sudo[107346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2
Jul 07 23:00:32 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:32 devstack sudo[107343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:32 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:33 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.761s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:33 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Deleted volume successfully.
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-df7258c4-cd9f-44eb-9fb7-c57a884d4b46 tempest-CreateVolumesFromImageTest-105118002 None] Lock "cinder-3d0d733b-82fb-402d-b5c9-8a57e98d09ae-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:33 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 1 in 0.883s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:33 devstack sudo[107353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85
Jul 07 23:00:33 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:33 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2" returned: 0 in 0.953s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.260s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f516f5df-3d79-4469-9238-0ecbd976c016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8355c9cf-b03e-4b7f-939c-4d991c05bc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Creating offline snapshot ac83a5d4-e094-4359-9221-f539e7aaaa25 of volume fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:00:33 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Volume volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 (6822dfc7-8fc9-4979-80ad-a8045804c6d2): created successfully
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8355c9cf-b03e-4b7f-939c-4d991c05bc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Flow 'volume_create_manager' (3b661b45-20c7-4fa8-a925-a1b1e8eb04fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00b586-ed22-4950-8486-b110f5030490]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:33 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-906968b4-be72-4a9d-af65-26cf39785413 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created volume successfully.
Jul 07 23:00:33 devstack sudo[107356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851
Jul 07 23:00:33 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:33 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-845cba18-19bc-4dde-90ab-a199283d0f85" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "cinder-quobyte-845cba18-19bc-4dde-90ab-a199283d0f85" released by "delete_volume" :: held 2.474s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:33 devstack sudo[107359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:33 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:33 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Created reservations ['4edcab99-0947-4856-806d-85b32894b873', '7d808fd5-4413-4420-a975-4ab7a9927db0', '4deaf603-dd4b-48dd-9acf-ab3f02828210', '47eb46e5-ab15-4e50-bfe8-b15b3d82191f'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-6822dfc7-8fc9-4979-80ad-a8045804c6d2-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:34 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:34 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-6822dfc7-8fc9-4979-80ad-a8045804c6d2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:34 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851" returned: 0 in 0.987s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-6822dfc7-8fc9-4979-80ad-a8045804c6d2" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:34 devstack sudo[107367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 1G
Jul 07 23:00:34 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-6822dfc7-8fc9-4979-80ad-a8045804c6d2" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78cca67-293c-4d31-865b-8ddc950ad4ab]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:34 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2
Jul 07 23:00:34 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:35 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.120s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:00:35 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.196s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:35 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Deleted volume successfully.
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-661d4cb8-887e-42e6-899a-78642ae0d249 tempest-VolumeAndVolumeTypeFromImageTest-332764661 None] Lock "cinder-845cba18-19bc-4dde-90ab-a199283d0f85-delete_volume" released by "delete_volume" :: held 4.030s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:35 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2" returned: 0 in 0.997s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:35 devstack sudo[107381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2
Jul 07 23:00:35 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:35 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 1G" returned: 0 in 1.191s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7e39db-7a13-4589-b551-e24e11db1851 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:35 devstack sudo[107383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7e39db-7a13-4589-b551-e24e11db1851 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25
Jul 07 23:00:35 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:36 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6822dfc7-8fc9-4979-80ad-a8045804c6d2" returned: 0 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-6822dfc7-8fc9-4979-80ad-a8045804c6d2" released by "delete_volume" :: held 1.860s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['83617d58-0d2e-4919-9adb-2570eb1babd7', '02547fb4-4103-4c46-83c4-a988e15fa8ff', 'ef14a3cb-36ed-430d-a1f9-7e86168d0776', 'cf7f3b7e-811f-4df2-9695-df0cdf7cd3bd'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:36 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe7e39db-7a13-4589-b551-e24e11db1851 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25" returned: 0 in 0.800s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:36 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 is being set with open permissions: ugo+rw
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:36 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25
Jul 07 23:00:36 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:36 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:36 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-0c11b36b-86f2-408d-ac91-52c831f4adc0-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-0c11b36b-86f2-408d-ac91-52c831f4adc0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-0c11b36b-86f2-408d-ac91-52c831f4adc0" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-0c11b36b-86f2-408d-ac91-52c831f4adc0" acquired by "delete_volume" :: waited 0.044s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3597054-d83c-4518-86a2-aa6c51a35768]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:37 devstack sudo[107395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0
Jul 07 23:00:37 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (1a5e6e61-07e0-4dfc-9795-92fa1e4d1584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685756fc-cc66-4a80-a32d-fd7b99561c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685756fc-cc66-4a80-a32d-fd7b99561c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014214369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e93656d-0d72-4922-84da-b7cbba41168a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:37Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7722094f-ca55-497f-85e1-cecb18b1fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7722094f-ca55-497f-85e1-cecb18b1fb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438d03e1-2c1b-4947-986a-a4360509a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438d03e1-2c1b-4947-986a-a4360509a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e93656d-0d72-4922-84da-b7cbba41168a', 'volume_name': 'volume-9e93656d-0d72-4922-84da-b7cbba41168a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c288b6-ad9e-4c9b-99c1-819662d0bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:37 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0c288b6-ad9e-4c9b-99c1-819662d0bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d679f889-3da3-416c-b8a4-fef65fc3b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume 9e93656d-0d72-4922-84da-b7cbba41168a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e93656d-0d72-4922-84da-b7cbba41168a', 'volume_size': 1}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25" returned: 0 in 1.129s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:37 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info
Jul 07 23:00:37 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:37 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.203s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a0d9782c-c688-4e86-b384-653ffc42292d tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-6822dfc7-8fc9-4979-80ad-a8045804c6d2-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:37 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0" returned: 0 in 1.073s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:37 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0
Jul 07 23:00:37 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:38 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info" returned: 0 in 0.739s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:38 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info is being set with open permissions: ugo+rw
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:38 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info
Jul 07 23:00:38 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:38 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0c11b36b-86f2-408d-ac91-52c831f4adc0" returned: 0 in 0.734s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-0c11b36b-86f2-408d-ac91-52c831f4adc0" released by "delete_volume" :: held 1.904s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['6b81acdf-9845-41a8-8097-467d1a9930d0', '345c247c-ec0d-43a9-8fda-80d1930060ae', '25a2ab29-d219-4424-86a1-c45dc6aee720', 'aa71c5d7-7521-43d7-824a-240fa3896279'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:38 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.info" returned: 0 in 0.725s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:38 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:38 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.732s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014214369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e93656d-0d72-4922-84da-b7cbba41168a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:37Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume 9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:39 devstack sudo[107413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a 1073741824
Jul 07 23:00:39 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-89772233-db66-4440-b0b8-6105dbd5a2f7 tempest-CinderUnicodeTest-1397564266 None] Create snapshot completed successfully
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-549daba8-079d-4456-ad7a-205d8bc86de7-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-549daba8-079d-4456-ad7a-205d8bc86de7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-549daba8-079d-4456-ad7a-205d8bc86de7" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-549daba8-079d-4456-ad7a-205d8bc86de7" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7bd7992-6d88-45df-8ec0-eadf0ec5925e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:39 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7
Jul 07 23:00:39 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:39 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.949s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-13c2fa46-4a90-45e2-8190-bcd5e09fdde9 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-0c11b36b-86f2-408d-ac91-52c831f4adc0-delete_volume" released by "delete_volume" :: held 3.256s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-ac83a5d4-e094-4359-9221-f539e7aaaa25-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-ac83a5d4-e094-4359-9221-f539e7aaaa25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-quobyte-ac83a5d4-e094-4359-9221-f539e7aaaa25" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-ac83a5d4-e094-4359-9221-f539e7aaaa25" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Deleting offline snapshot ac83a5d4-e094-4359-9221-f539e7aaaa25 of volume fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:00:40 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] snapshot_file for this snap is: volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[8162838b-380a-48fe-8e11-17f5547e2b1b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:40 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7
Jul 07 23:00:40 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:40 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a 1073741824" returned: 0 in 1.129s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:40 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a
Jul 07 23:00:40 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:40 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25
Jul 07 23:00:40 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:40 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-549daba8-079d-4456-ad7a-205d8bc86de7" returned: 0 in 0.742s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-549daba8-079d-4456-ad7a-205d8bc86de7" released by "delete_volume" :: held 1.687s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['5e74e048-ca56-4b33-9082-816766090afc', 'e69c0eaa-5dbe-4ed4-8e08-b144964cb1bb', 'f6fe9e95-05f7-49e4-a4a3-b9d7adbec725', 'd9810fc3-9a7d-44f2-8709-4122822c3af3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:40 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a" returned: 0 in 0.777s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d679f889-3da3-416c-b8a4-fef65fc3b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e93656d-0d72-4922-84da-b7cbba41168a', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd38fec-f4cb-4394-b326-b14ffbb3707d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-9e93656d-0d72-4922-84da-b7cbba41168a (9e93656d-0d72-4922-84da-b7cbba41168a): created successfully
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd38fec-f4cb-4394-b326-b14ffbb3707d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (1a5e6e61-07e0-4dfc-9795-92fa1e4d1584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:41 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3804a8b1-1a12-45fb-a248-8608ee16f5df tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25" returned: 0 in 0.966s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe7e39db-7a13-4589-b551-e24e11db1851(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:00:41 devstack sudo[107444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:41 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2d94a-4e81-418a-96e7-45dbea99ab39]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Flow 'volume_create_manager' (91d5a164-b8ba-4cf2-8b9d-165cc1a4e6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b1b4c-32a8-44b0-93d9-b3ab554b5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (823b1b4c-32a8-44b0-93d9-b3ab554b5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468052237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56961199-baf5-4cca-a7f3-a43629662bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72500ea7ef94a27b2dc9894a3a092e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:41Z,use_quota=True,user_id='8e7aefb4d6dc4cd4875ae2d43b5f22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a6df17-045b-4a39-ac51-ae4f2fe7971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a6df17-045b-4a39-ac51-ae4f2fe7971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6c941f-cdd1-4d92-8933-b3dd70243402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6c941f-cdd1-4d92-8933-b3dd70243402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56961199-baf5-4cca-a7f3-a43629662bcc', 'volume_name': 'volume-56961199-baf5-4cca-a7f3-a43629662bcc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823558b-337f-43d3-b6b8-dbb71050ad2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b823558b-337f-43d3-b6b8-dbb71050ad2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cea5575-6103-4719-8e1a-4781b5ed946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Volume 56961199-baf5-4cca-a7f3-a43629662bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56961199-baf5-4cca-a7f3-a43629662bcc', 'volume_size': 1}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-468052237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56961199-baf5-4cca-a7f3-a43629662bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72500ea7ef94a27b2dc9894a3a092e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:41Z,use_quota=True,user_id='8e7aefb4d6dc4cd4875ae2d43b5f22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Creating volume 56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:41 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851
Jul 07 23:00:41 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:41 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:41 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc 1073741824
Jul 07 23:00:41 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-e66a70f8-8d97-4680-9837-5cba72d6551b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-e66a70f8-8d97-4680-9837-5cba72d6551b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-e66a70f8-8d97-4680-9837-5cba72d6551b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-e66a70f8-8d97-4680-9837-5cba72d6551b" acquired by "delete_volume" :: waited 0.032s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce3ed23-a821-44f6-bfb6-ab5007f76aa4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:41 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.774s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:41 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-fe8bd768-b087-4aa2-a11d-094a8918383a tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-549daba8-079d-4456-ad7a-205d8bc86de7-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:41 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b
Jul 07 23:00:41 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:42 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851" returned: 0 in 0.969s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:42 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25
Jul 07 23:00:42 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:42 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc 1073741824" returned: 0 in 1.037s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:42 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:00:42 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:42 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b" returned: 0 in 0.974s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:42 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b
Jul 07 23:00:42 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:42 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25" returned: 0 in 0.870s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:42 devstack sudo[107472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25
Jul 07 23:00:42 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:43 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.355s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cea5575-6103-4719-8e1a-4781b5ed946e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56961199-baf5-4cca-a7f3-a43629662bcc', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc34228-dbed-461c-a43c-0db27db68683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating offline snapshot 401a8107-3911-4fac-994f-772fc52b849f of volume 9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:00:43 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Volume volume-56961199-baf5-4cca-a7f3-a43629662bcc (56961199-baf5-4cca-a7f3-a43629662bcc): created successfully
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc34228-dbed-461c-a43c-0db27db68683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Flow 'volume_create_manager' (91d5a164-b8ba-4cf2-8b9d-165cc1a4e6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d87880b-28c6-4033-9224-c8a6afd52111]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d3333263-c806-48e1-846b-c6fd83ff260d tempest-VolumeDependencyTests-1795720527 None] Created volume successfully.
Jul 07 23:00:43 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a
Jul 07 23:00:43 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:43 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-e66a70f8-8d97-4680-9837-5cba72d6551b" returned: 0 in 0.704s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-e66a70f8-8d97-4680-9837-5cba72d6551b" released by "delete_volume" :: held 1.740s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['21518867-51fe-4f8e-8f69-581c9a22d3aa', '076a140d-ffd0-4b9b-8ce6-69076baf8303', 'be8d9494-2260-446b-9311-20885c45ca8c', 'dd1cd788-c7c9-4bc5-abfc-63101f690f6c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:43 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:43 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:43 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851.ac83a5d4-e094-4359-9221-f539e7aaaa25" returned: 0 in 0.730s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-ac83a5d4-e094-4359-9221-f539e7aaaa25" released by "_delete_snapshot" :: held 3.669s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" released by "delete_snapshot" :: held 3.698s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Created reservations ['a68d188b-bd60-4760-a6e9-1688021de25b', 'b4e37a6f-1150-4311-a92e-e1bfcc070d8b', '995492b0-19ed-464e-a279-e3bb86119848', 'ea1364c3-7245-4a4a-bd1c-781214679944'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Delete snapshot completed successfully.
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-873423bc-9aec-4916-bdc2-1f87f3a8cd26 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-ac83a5d4-e094-4359-9221-f539e7aaaa25-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02cac39-199c-4836-83fb-809abf1899fd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:44 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a" returned: 0 in 0.871s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:44 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3
Jul 07 23:00:44 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:44 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f 1G
Jul 07 23:00:44 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-fe7e39db-7a13-4589-b551-e24e11db1851-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-fe7e39db-7a13-4589-b551-e24e11db1851-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:44 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.814s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d217c59f-a10a-4071-ba85-ce3e4639f149 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-e66a70f8-8d97-4680-9837-5cba72d6551b-delete_volume" released by "delete_volume" :: held 2.857s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ac99ed-c865-45cb-b90b-a7ffdeadfbed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:44 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851
Jul 07 23:00:44 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:44 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:44 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3
Jul 07 23:00:44 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:45 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f 1G" returned: 0 in 1.047s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e93656d-0d72-4922-84da-b7cbba41168a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:45 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e93656d-0d72-4922-84da-b7cbba41168a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f
Jul 07 23:00:45 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:45 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851" returned: 0 in 0.853s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:45 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851
Jul 07 23:00:45 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:45 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" returned: 0 in 0.696s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3" released by "delete_volume" :: held 1.607s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['456c31f4-cb64-401b-984f-1da5fabefdae', 'a623b116-7796-495e-a74d-663450ff92ef', '9295f9dd-bc93-4c6f-92d0-1587daa66ad1', 'a56d248c-4bcb-4476-92ae-ba95ff9374da'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:45 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:45 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:45 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e93656d-0d72-4922-84da-b7cbba41168a -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f" returned: 0 in 0.707s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f is being set with open permissions: ugo+rw
Jul 07 23:00:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:45 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f
Jul 07 23:00:45 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-277bf367-d30f-4a5f-92e7-7591476fe12f-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-277bf367-d30f-4a5f-92e7-7591476fe12f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:46 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fe7e39db-7a13-4589-b551-e24e11db1851" returned: 0 in 0.748s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-fe7e39db-7a13-4589-b551-e24e11db1851" released by "delete_volume" :: held 1.696s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "cinder-quobyte-277bf367-d30f-4a5f-92e7-7591476fe12f" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-277bf367-d30f-4a5f-92e7-7591476fe12f" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fc1a01-be46-4cbf-b19b-1f2c79c9ac10]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Created reservations ['56819cd4-51cb-4e4f-89ce-33a4a33d7565', 'be521258-11dd-462b-860e-2308f544629c', 'c90a328b-24c2-418a-871b-6ab8244dd16e', 'f30bbbb8-8a31-404c-9010-db7e0465dcce'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:46 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f
Jul 07 23:00:46 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:46 devstack sudo[107518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:46 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:46 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-234125a6-3841-442a-a796-96c1296953da tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-093ea621-6cb4-43d1-adcd-2a9a7fd3e6c3-delete_volume" released by "delete_volume" :: held 2.651s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-c7266d3b-42b7-43a8-a0a3-8a922606d351-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-c7266d3b-42b7-43a8-a0a3-8a922606d351-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:46 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f" returned: 0 in 0.829s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "cinder-quobyte-c7266d3b-42b7-43a8-a0a3-8a922606d351" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-c7266d3b-42b7-43a8-a0a3-8a922606d351" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bd2497-3075-4156-b665-8ee8bc42d682]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:46 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info
Jul 07 23:00:46 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:46 devstack sudo[107523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351
Jul 07 23:00:46 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:47 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.802s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Deleted volume successfully.
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a616eba6-1d13-4fe9-80f1-d5abe459760f tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-fe7e39db-7a13-4589-b551-e24e11db1851-delete_volume" released by "delete_volume" :: held 2.901s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:47 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f" returned: 0 in 1.161s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:47 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f
Jul 07 23:00:47 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:47 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info" returned: 0 in 0.719s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:47 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info is being set with open permissions: ugo+rw
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:47 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info
Jul 07 23:00:47 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:47 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351" returned: 0 in 0.946s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:47 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351
Jul 07 23:00:47 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:48 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-277bf367-d30f-4a5f-92e7-7591476fe12f" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-quobyte-277bf367-d30f-4a5f-92e7-7591476fe12f" released by "delete_volume" :: held 1.923s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:48 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.info" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.569s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Creating offline snapshot eeb0b77c-2013-4c05-af56-10e8560a4094 of volume 56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38889d-e8bf-4f0d-b62c-ecb21d0288b7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-877cd534-49d7-42c6-84bc-cb1ee2cabcde tempest-CreateVolumesFromSnapshotTest-189927989 None] Create snapshot completed successfully
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Created reservations ['d601066d-d35e-48c7-8c42-2018b443bd40', 'f0e550f9-48b6-499c-a3ce-e79990121aa7', '5fff36e8-2083-42c6-b3f4-d2ae17285cef', '12812acf-adf2-410a-99fa-21f66a9851eb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:48 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:00:48 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:48 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:48 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:48 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-c7266d3b-42b7-43a8-a0a3-8a922606d351" returned: 0 in 0.732s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-quobyte-c7266d3b-42b7-43a8-a0a3-8a922606d351" released by "delete_volume" :: held 1.747s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Created reservations ['a4119081-8eeb-464c-8f40-91faedc6abcb', '56921216-cb0d-462c-898c-efe5cfb7c234', 'ffe13552-3bca-45d6-b78b-a530f2a0177b', '74ce5dfd-497e-4f7b-97c5-1f3cb80b3141'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:48 devstack sudo[107547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:00:48 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:49 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 0.910s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:49 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 1G
Jul 07 23:00:49 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:49 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.815s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Deleted volume successfully.
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-bc596f01-741b-408c-9ebf-1453def73ce3 tempest-CreateVolumesFromSourceVolumeTest-796720611 None] Lock "cinder-277bf367-d30f-4a5f-92e7-7591476fe12f-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:49 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:00:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Deleted volume successfully.
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a7b955e9-f618-42a8-a802-bb8594094fa5 tempest-CinderUnicodeTest-1397564266 None] Lock "cinder-c7266d3b-42b7-43a8-a0a3-8a922606d351-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (0729e385-7a6f-4c94-8c5b-3053344b3942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6548470-89b4-4266-8f7e-204a1dd94b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6548470-89b4-4266-8f7e-204a1dd94b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163779499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae698ec-0c8f-4fa6-9422-2129374a6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89ed488-fab5-4943-88d8-912fa7b35018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89ed488-fab5-4943-88d8-912fa7b35018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ebb61b-5bdc-4ac1-a8ec-bc1f96e88f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ebb61b-5bdc-4ac1-a8ec-bc1f96e88f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae698ec-0c8f-4fa6-9422-2129374a6d96', 'volume_name': 'volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9349af7-43fe-4e32-ac22-b958a81e71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9349af7-43fe-4e32-ac22-b958a81e71e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b666b-24bc-411c-9d3e-c126ccf5ee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume 0ae698ec-0c8f-4fa6-9422-2129374a6d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96', 'volume_size': 1}
Jul 07 23:00:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (a1f1835c-1296-4ce8-b4c6-34b97d904736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbdbd96-c835-4680-81b0-a0e12bfe6d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbdbd96-c835-4680-81b0-a0e12bfe6d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496575683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928092c4-52cb-47d2-9461-d21e20df50e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8df59a-fd71-4989-8f5b-52f5e81cc35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8df59a-fd71-4989-8f5b-52f5e81cc35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71224cb-ec03-4624-8544-abd3f2cbe839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71224cb-ec03-4624-8544-abd3f2cbe839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928092c4-52cb-47d2-9461-d21e20df50e0', 'volume_name': 'volume-928092c4-52cb-47d2-9461-d21e20df50e0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba0b648-4223-4879-a622-9ae0de7adccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ba0b648-4223-4879-a622-9ae0de7adccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13f38ba-3723-421c-ac4a-92c626c3bde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:50 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume 928092c4-52cb-47d2-9461-d21e20df50e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928092c4-52cb-47d2-9461-d21e20df50e0', 'volume_size': 1}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:50 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 1G" returned: 0 in 1.381s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56961199-baf5-4cca-a7f3-a43629662bcc -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:50 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56961199-baf5-4cca-a7f3-a43629662bcc -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:00:50 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (54813282-74be-4067-9b63-3a95270ccbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:50 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f5d47-60e2-4ea7-9683-747549d79088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194f5d47-60e2-4ea7-9683-747549d79088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750266604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f600777-05fd-45d4-9492-eeac52402393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:51Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a5389-de32-4fcc-85c0-54a31f25728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97a5389-de32-4fcc-85c0-54a31f25728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6bfdbf-f982-454d-b1b7-de53587679b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c6bfdbf-f982-454d-b1b7-de53587679b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f600777-05fd-45d4-9492-eeac52402393', 'volume_name': 'volume-5f600777-05fd-45d4-9492-eeac52402393', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf4f6f6-cc3d-4e0f-8e74-e8a2bdf01a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bf4f6f6-cc3d-4e0f-8e74-e8a2bdf01a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b84ef-6907-4420-acd5-04c809f9ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume 5f600777-05fd-45d4-9492-eeac52402393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f600777-05fd-45d4-9492-eeac52402393', 'volume_size': 1}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (52009d5b-5d2c-49a8-b281-387f38ab915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9850759-606b-47dd-939e-363e41c006e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9850759-606b-47dd-939e-363e41c006e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104018226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f07f29-c450-4b62-a168-74c207f6eaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:51Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f7315-89e2-4c45-95ed-2072f7370ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e2f7315-89e2-4c45-95ed-2072f7370ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a89f5-4325-4c01-81dc-53d20a4a25d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a89f5-4325-4c01-81dc-53d20a4a25d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1f07f29-c450-4b62-a168-74c207f6eaef', 'volume_name': 'volume-a1f07f29-c450-4b62-a168-74c207f6eaef', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2bfcfb-9ea7-44a2-89f1-03a4d632c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2bfcfb-9ea7-44a2-89f1-03a4d632c29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd59c7ca-6a52-4049-a168-aed66353d61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume a1f07f29-c450-4b62-a168-74c207f6eaef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1f07f29-c450-4b62-a168-74c207f6eaef', 'volume_size': 1}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56961199-baf5-4cca-a7f3-a43629662bcc -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 1.138s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:51 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 is being set with open permissions: ugo+rw
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:51 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:00:51 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (7e47ed29-1fc1-4d8f-844e-a880babef573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdf5981-7503-4f6b-a152-5b90fad56b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fdf5981-7503-4f6b-a152-5b90fad56b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031311564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1389d2ec-35f4-4542-8c87-3d8abf1842a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c521ab02-3ae6-440c-8cf2-122f9357af77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c521ab02-3ae6-440c-8cf2-122f9357af77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9072ebd-646f-44b2-a438-ed1125abe214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:51 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9072ebd-646f-44b2-a438-ed1125abe214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1389d2ec-35f4-4542-8c87-3d8abf1842a8', 'volume_name': 'volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fa55c7-c3e0-4f73-9e45-4f6ad57f407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73fa55c7-c3e0-4f73-9e45-4f6ad57f407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f64bd7-b55f-4027-98e6-217b224b9f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:52 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume 1389d2ec-35f4-4542-8c87-3d8abf1842a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8', 'volume_size': 1}
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:52 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 0.776s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:52 devstack sudo[107570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info
Jul 07 23:00:52 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:53 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info" returned: 0 in 0.733s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:53 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info is being set with open permissions: ugo+rw
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:53 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info
Jul 07 23:00:53 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:53 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.info" returned: 0 in 0.666s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.720s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.901s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163779499',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae698ec-0c8f-4fa6-9422-2129374a6d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume 0ae698ec-0c8f-4fa6-9422-2129374a6d96 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:53 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:53 devstack sudo[107576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 1073741824
Jul 07 23:00:53 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-345322a0-e19d-4e38-9def-dc81bca846c7 tempest-VolumeDependencyTests-1795720527 None] Create snapshot completed successfully
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-dfdcff52-bbdd-4270-b355-cf170cf9965d tempest-ProjectAdminTests-1462396469 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.687099456787, 'free_capacity_gb': 1775.687099456787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88152) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=140,cinder:UPDATE=169,cinder:INSERT=49,cinder:DELETE=15 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Flow 'volume_create_manager' (08467b10-afe7-4f70-b7fc-500504d96f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb2819-a6d7-48fd-9b14-c2edf250fc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfeb2819-a6d7-48fd-9b14-c2edf250fc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-482597943',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90029820-3875-41e9-8240-9231409441a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72500ea7ef94a27b2dc9894a3a092e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eeb0b77c-2013-4c05-af56-10e8560a4094,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:55Z,use_quota=True,user_id='8e7aefb4d6dc4cd4875ae2d43b5f22f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792052b7-2744-43a0-9ff8-1d820743cca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792052b7-2744-43a0-9ff8-1d820743cca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042695a0-d4cf-467c-a5e1-bcca940cf019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042695a0-d4cf-467c-a5e1-bcca940cf019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '90029820-3875-41e9-8240-9231409441a9', 'volume_name': 'volume-90029820-3875-41e9-8240-9231409441a9', 'volume_size': 1, 'snapshot_id': 'eeb0b77c-2013-4c05-af56-10e8560a4094'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc35857-4c31-4d4b-9fe4-1ec0cd37772f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc35857-4c31-4d4b-9fe4-1ec0cd37772f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aeb80c1-e40f-4436-a966-d1e22e558082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Volume 90029820-3875-41e9-8240-9231409441a9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-90029820-3875-41e9-8240-9231409441a9', 'volume_size': 1, 'snapshot_id': 'eeb0b77c-2013-4c05-af56-10e8560a4094'}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=122,cinder:UPDATE=181,cinder:INSERT=40,cinder:DELETE=18 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:54 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 1073741824" returned: 0 in 0.956s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:54 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96
Jul 07 23:00:54 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:55 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96" returned: 0 in 0.731s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.134s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1496575683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928092c4-52cb-47d2-9461-d21e20df50e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:50Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume 928092c4-52cb-47d2-9461-d21e20df50e0 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:55 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b666b-24bc-411c-9d3e-c126ccf5ee33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3145ea94-d0dd-4b6d-ab4f-1ef88bb531b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:55 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 1073741824
Jul 07 23:00:55 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:55 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 (0ae698ec-0c8f-4fa6-9422-2129374a6d96): created successfully
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3145ea94-d0dd-4b6d-ab4f-1ef88bb531b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (0729e385-7a6f-4c94-8c5b-3053344b3942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-babbf20a-a094-4e36-87e4-c23c4d4baef2 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Flow 'volume_create_manager' (099a3448-45d9-41d9-b7ae-37d9c7f5fd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e30f01-f62a-476d-818c-209d7dfeedc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e30f01-f62a-476d-818c-209d7dfeedc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0697cec-8c18-4a4d-82a7-b66218b7ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a29a4921f045d8b915caab475d253d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:57Z,use_quota=True,user_id='e841294c4cf2438998aab73fb5186abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f7ba8d-fe00-4aef-826d-80329f6e0366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76f7ba8d-fe00-4aef-826d-80329f6e0366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d13fdf-898d-428e-a021-1281fc04f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG cinder.image.glance [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Creating Keystone auth plugin from conf {{(pid=88152) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 07 23:00:56 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 1073741824" returned: 0 in 1.078s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:56 devstack sudo[107592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0
Jul 07 23:00:56 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d13fdf-898d-428e-a021-1281fc04f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd0697cec-8c18-4a4d-82a7-b66218b7ef41', 'volume_name': 'volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41', 'volume_size': 1, 'image_id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca3ad230a9b2813c90d40a9bb1eef10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46a29a4921f045d8b915caab475d253d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89871b8efef0027e02fed74ccda91cb1b74e79502ae53f2e676a66bcd364e007f34487a9c8eb6926fd825080034433d32f1fcd2498b15383030829e74a35377e', 'id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7413a6f0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be958ca-a08e-4b3b-ab67-eb92c4ee3c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be958ca-a08e-4b3b-ab67-eb92c4ee3c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83888869-d31d-4fa2-a854-c538c0fabe21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Volume d0697cec-8c18-4a4d-82a7-b66218b7ef41: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41', 'volume_size': 1, 'image_id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca3ad230a9b2813c90d40a9bb1eef10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46a29a4921f045d8b915caab475d253d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89871b8efef0027e02fed74ccda91cb1b74e79502ae53f2e676a66bcd364e007f34487a9c8eb6926fd825080034433d32f1fcd2498b15383030829e74a35377e', 'id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7413a6f0>}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Trying to clone d0697cec-8c18-4a4d-82a7-b66218b7ef41 from image edecd74c-8ca7-41de-830b-5c52d28fa4e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}]). {{(pid=88152) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 07 23:00:57 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Image download 0.00 MB at 0.00 MB/s
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb991f-636c-4834-b010-aa9e3fbdc2e5]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:57 devstack sudo[107594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:00:57 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:57 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0" returned: 0 in 0.741s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.462s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1750266604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f600777-05fd-45d4-9492-eeac52402393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:51Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume 5f600777-05fd-45d4-9492-eeac52402393 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:57 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:57 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 1073741824
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13f38ba-3723-421c-ac4a-92c626c3bde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928092c4-52cb-47d2-9461-d21e20df50e0', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:57 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba7e6b-2661-43c9-989a-84ea650419f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-928092c4-52cb-47d2-9461-d21e20df50e0 (928092c4-52cb-47d2-9461-d21e20df50e0): created successfully
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bba7e6b-2661-43c9-989a-84ea650419f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (a1f1835c-1296-4ce8-b4c6-34b97d904736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-db3f2df5-b7d2-4ba8-bc22-aa3afb9f7e9d tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:00:58 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 0 in 0.857s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:58 devstack sudo[107605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:00:58 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:58 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 1073741824" returned: 0 in 1.052s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:58 devstack sudo[107611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393
Jul 07 23:00:58 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:59 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 1 in 0.931s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Temporary image edecd74c-8ca7-41de-830b-5c52d28fa4e0 is fetched for user e841294c4cf2438998aab73fb5186abd. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61dc250-505a-41c4-8d41-4b72a550da9b]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:59 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:00:59 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:59 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393" returned: 0 in 0.718s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.722s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2104018226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1f07f29-c450-4b62-a168-74c207f6eaef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:51Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume a1f07f29-c450-4b62-a168-74c207f6eaef {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:00:59 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (745b84ef-6907-4420-acd5-04c809f9ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f600777-05fd-45d4-9492-eeac52402393', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:59 devstack sudo[107619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef 1073741824
Jul 07 23:00:59 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71227be-b47a-41a3-bc35-f21c10312b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:00:59 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-5f600777-05fd-45d4-9492-eeac52402393 (5f600777-05fd-45d4-9492-eeac52402393): created successfully
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71227be-b47a-41a3-bc35-f21c10312b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:00:59 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (54813282-74be-4067-9b63-3a95270ccbe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:00:59 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f0a374ac-b758-443a-bef8-9eedcbd37043 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:01:00 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 0 in 0.863s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:00 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:01:00 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:00 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef 1073741824" returned: 0 in 1.103s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:00 devstack sudo[107629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef
Jul 07 23:01:00 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:00 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 1 in 0.857s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:01 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef" returned: 0 in 0.700s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.208s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2031311564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1389d2ec-35f4-4542-8c87-3d8abf1842a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2eafc3a2b0b64ca581c13cdef4853d07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:52Z,use_quota=True,user_id='4c14c62d7e1f4f27ab010f5d4a7d67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Creating volume 1389d2ec-35f4-4542-8c87-3d8abf1842a8 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:01 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd59c7ca-6a52-4049-a168-aed66353d61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1f07f29-c450-4b62-a168-74c207f6eaef', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:01 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 1073741824
Jul 07 23:01:01 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b62319-77b7-4627-ac7c-fccae7bcc5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:01 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-a1f07f29-c450-4b62-a168-74c207f6eaef (a1f07f29-c450-4b62-a168-74c207f6eaef): created successfully
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b62319-77b7-4627-ac7c-fccae7bcc5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:01 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (52009d5b-5d2c-49a8-b281-387f38ab915a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-27f81cb2-3d7a-4f51-a46d-8edd53a9ed70 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:01:02 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 1073741824" returned: 0 in 1.014s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:02 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8
Jul 07 23:01:02 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:02 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8" returned: 0 in 0.677s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.196s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094-90029820-3875-41e9-8240-9231409441a9" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094-90029820-3875-41e9-8240-9231409441a9" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Creating volume 90029820-3875-41e9-8240-9231409441a9 from snapshot eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:02 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f64bd7-b55f-4027-98e6-217b224b9f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d543590-6667-4cd8-959d-a8a14c72ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] snapshot: eeb0b77c-2013-4c05-af56-10e8560a4094, volume: 90029820-3875-41e9-8240-9231409441a9,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 23:01:03 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Volume volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 (1389d2ec-35f4-4542-8c87-3d8abf1842a8): created successfully
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d543590-6667-4cd8-959d-a8a14c72ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Flow 'volume_create_manager' (7e47ed29-1fc1-4d8f-844e-a880babef573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a5f1d45f-8c2f-435e-9c8c-e8db8b54a890 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created volume successfully.
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71dfd5c-c0a0-4e87-b91a-f4a256246e98]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:03 devstack sudo[107644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:01:03 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:03 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 0.805s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56961199-baf5-4cca-a7f3-a43629662bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc7708a-9579-423b-824c-b181e8ed9a39]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-1389d2ec-35f4-4542-8c87-3d8abf1842a8-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:04 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:01:04 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-1389d2ec-35f4-4542-8c87-3d8abf1842a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-1389d2ec-35f4-4542-8c87-3d8abf1842a8" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-1389d2ec-35f4-4542-8c87-3d8abf1842a8" acquired by "delete_volume" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa1f79d-526f-4183-a68d-a33d2b2ed92c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:04 devstack sudo[107651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8
Jul 07 23:01:04 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:04 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 0.859s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 23:01:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:04 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9
Jul 07 23:01:04 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:05 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8" returned: 0 in 0.835s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:05 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8
Jul 07 23:01:05 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:05 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-1389d2ec-35f4-4542-8c87-3d8abf1842a8" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-1389d2ec-35f4-4542-8c87-3d8abf1842a8" released by "delete_volume" :: held 1.595s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['f72ce28e-2089-482f-aef2-c7760a8c683d', '57809c4e-3f70-474c-8b69-ae03364215fa', 'dcb58f61-3123-4865-9903-a20a696ca0c6', 'b1e85602-acb6-4267-89d7-8d79e351598b'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:06 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:06 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-a1f07f29-c450-4b62-a168-74c207f6eaef-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-a1f07f29-c450-4b62-a168-74c207f6eaef-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-a1f07f29-c450-4b62-a168-74c207f6eaef" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-a1f07f29-c450-4b62-a168-74c207f6eaef" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb194f78-0860-4f7f-aa51-40360b6301ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:07 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef
Jul 07 23:01:07 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:08 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 2.040s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:08 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d699d8ad-c45f-4d15-a768-6c64c50b6d00 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-1389d2ec-35f4-4542-8c87-3d8abf1842a8-delete_volume" released by "delete_volume" :: held 4.159s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:08 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef" returned: 0 in 1.488s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:08 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef
Jul 07 23:01:08 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:10 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a1f07f29-c450-4b62-a168-74c207f6eaef" returned: 0 in 2.332s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-a1f07f29-c450-4b62-a168-74c207f6eaef" released by "delete_volume" :: held 3.935s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['471d5fd8-39b9-4c48-b9c1-c3bcff72ae36', '23cdf584-834c-4fac-8e36-e826d29e58b9', 'fd9db5fd-aef6-4cea-89cd-ad01bf727031', '243e2cf6-76b7-4ede-b467-4f2e79e99c23'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:10 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9" returned: 0 in 6.094s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[470d1ef3-8737-48b2-b00c-b177a4176fa4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:10 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:10 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:11 devstack sudo[107725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:01:11 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-5f600777-05fd-45d4-9492-eeac52402393-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-5f600777-05fd-45d4-9492-eeac52402393-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-5f600777-05fd-45d4-9492-eeac52402393" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-5f600777-05fd-45d4-9492-eeac52402393" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ba36f-e7ee-4e88-95ba-58743d1dd96e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:11 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.817s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:11 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:11 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-cd10a308-f92d-4ba5-9c8f-12c120558633 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-a1f07f29-c450-4b62-a168-74c207f6eaef-delete_volume" released by "delete_volume" :: held 5.157s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:11 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393
Jul 07 23:01:11 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 1.107s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:01:12 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Converted 1024.00 MB image at 167.98 MB/s
Jul 07 23:01:12 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 is being set with open permissions: ugo+rw
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack sudo[107733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9
Jul 07 23:01:12 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393" returned: 0 in 0.892s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack sudo[107739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393
Jul 07 23:01:12 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9" returned: 0 in 0.755s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" released by "_copy_volume_from_snapshot" :: held 9.760s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094-90029820-3875-41e9-8240-9231409441a9" released by "_create_volume_from_snapshot" :: held 9.813s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.834s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.924s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0697cec-8c18-4a4d-82a7-b66218b7ef41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46a29a4921f045d8b915caab475d253d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:00:57Z,use_quota=True,user_id='e841294c4cf2438998aab73fb5186abd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Creating volume d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:12 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:12 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1073741824
Jul 07 23:01:12 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aeb80c1-e40f-4436-a966-d1e22e558082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90029820-3875-41e9-8240-9231409441a9', 'volume_size': 1, 'snapshot_id': 'eeb0b77c-2013-4c05-af56-10e8560a4094'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85b6769-72a5-42ed-a11b-eb00b9ed5e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Volume volume-90029820-3875-41e9-8240-9231409441a9 (90029820-3875-41e9-8240-9231409441a9): created successfully
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85b6769-72a5-42ed-a11b-eb00b9ed5e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Flow 'volume_create_manager' (08467b10-afe7-4f70-b7fc-500504d96f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a42219e2-9f7a-4730-ab0a-dca6ce909223 tempest-VolumeDependencyTests-1795720527 None] Created volume successfully.
Jul 07 23:01:13 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-5f600777-05fd-45d4-9492-eeac52402393" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-5f600777-05fd-45d4-9492-eeac52402393" released by "delete_volume" :: held 1.635s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['101b899e-b6d6-4f4e-85ed-8e88c7499b1c', '3d8300ee-db87-465a-b949-375bebbcf08a', 'c15a0a41-b7d9-4dfd-b693-c64fb48fbd26', '632c2971-4db9-4a56-8018-ec15bacd613e'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-eeb0b77c-2013-4c05-af56-10e8560a4094-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack sudo[107745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:13 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-eeb0b77c-2013-4c05-af56-10e8560a4094-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Deleting offline snapshot eeb0b77c-2013-4c05-af56-10e8560a4094 of volume 56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] snapshot_file for this snap is: volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b2e56-7417-4e9f-a725-f25a0a42412c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:13 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:01:13 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-928092c4-52cb-47d2-9461-d21e20df50e0-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-928092c4-52cb-47d2-9461-d21e20df50e0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:13 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-928092c4-52cb-47d2-9461-d21e20df50e0" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-928092c4-52cb-47d2-9461-d21e20df50e0" acquired by "delete_volume" :: waited 0.046s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79dc5a6-6c6d-4b07-bd96-d8140db85d83]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1073741824" returned: 0 in 1.289s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[107753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0
Jul 07 23:01:14 devstack sudo[107754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:14 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:14 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:14 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.004s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:14 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-81365fd6-a786-4c1a-a7de-aa83bc839ed8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-5f600777-05fd-45d4-9492-eeac52402393-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:14 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 1.226s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56961199-baf5-4cca-a7f3-a43629662bcc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e74695-cf18-43c9-924b-5013cafdc0be]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:14 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 0 in 0.828s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:15 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:01:15 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Attempting download of edecd74c-8ca7-41de-830b-5c52d28fa4e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}])) to volume d0697cec-8c18-4a4d-82a7-b66218b7ef41. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d6ad1b-7ffe-498b-aafb-c6ebe09beb26]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:15 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc
Jul 07 23:01:15 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0" returned: 0 in 1.215s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[107769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0
Jul 07 23:01:15 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Flow 'volume_create_manager' (da8d0d46-4e3d-4f38-9318-21965fffd03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a762ca9-abf4-412e-a2a8-50c83005985d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a762ca9-abf4-412e-a2a8-50c83005985d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156411920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ff1cea-661b-455a-9a61-54e5340c0204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2969bef8e16640ab9ed1758c3b373e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:16Z,use_quota=True,user_id='3960b3bbc49547258da9c6fdd1c0ef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313cbf21-95f9-4614-bed5-4d356bad4f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313cbf21-95f9-4614-bed5-4d356bad4f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0043ec-a8c4-4ae8-be2b-1d0560a5460c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0043ec-a8c4-4ae8-be2b-1d0560a5460c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ff1cea-661b-455a-9a61-54e5340c0204', 'volume_name': 'volume-58ff1cea-661b-455a-9a61-54e5340c0204', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b686e2cb-15ff-41da-936f-eaae570e31f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b686e2cb-15ff-41da-936f-eaae570e31f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ac19e4-03db-459d-afc1-0acab993803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:15 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Volume 58ff1cea-661b-455a-9a61-54e5340c0204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ff1cea-661b-455a-9a61-54e5340c0204', 'volume_size': 1}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1156411920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ff1cea-661b-455a-9a61-54e5340c0204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2969bef8e16640ab9ed1758c3b373e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:16Z,use_quota=True,user_id='3960b3bbc49547258da9c6fdd1c0ef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Creating volume 58ff1cea-661b-455a-9a61-54e5340c0204 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:15 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 0.964s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:15 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 1073741824
Jul 07 23:01:15 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack sudo[107775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:01:15 devstack sudo[107775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:15 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc" returned: 0 in 0.887s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-928092c4-52cb-47d2-9461-d21e20df50e0" returned: 0 in 0.835s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-928092c4-52cb-47d2-9461-d21e20df50e0" released by "delete_volume" :: held 2.100s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:16 devstack sudo[107781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc
Jul 07 23:01:16 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['05763cba-0319-4583-be87-997e4ca6068b', '2ec95cbd-b3fe-4367-8f6d-1eb9526fb345', '5afd3b7b-0bb1-4255-a5af-e8d24506740c', '88617e1a-fc66-4018-8952-3f706b930c09'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:16 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 1073741824" returned: 0 in 0.991s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack sudo[107775]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc" returned: 1 in 0.852s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edecd74c-8ca7-41de-830b-5c52d28fa4e0_3vlklzkc' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[394504c6-ab8b-44c5-8aa0-3b12cf0e4892]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 1.015s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:16 devstack sudo[107796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094
Jul 07 23:01:16 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204
Jul 07 23:01:16 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:16 devstack sudo[107795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:01:16 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.825s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-abb13605-5c3c-4b73-8abf-2338cf4926a8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-928092c4-52cb-47d2-9461-d21e20df50e0-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-0ae698ec-0c8f-4fa6-9422-2129374a6d96-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-0ae698ec-0c8f-4fa6-9422-2129374a6d96-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-0ae698ec-0c8f-4fa6-9422-2129374a6d96" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-0ae698ec-0c8f-4fa6-9422-2129374a6d96" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2d0c6d-341f-4953-905a-64524f26630b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:17 devstack sudo[107803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96
Jul 07 23:01:17 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5ac19e4-03db-459d-afc1-0acab993803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ff1cea-661b-455a-9a61-54e5340c0204', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043e6de0-544e-4c2a-a7ea-e47f0401bbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:17 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Volume volume-58ff1cea-661b-455a-9a61-54e5340c0204 (58ff1cea-661b-455a-9a61-54e5340c0204): created successfully
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043e6de0-544e-4c2a-a7ea-e47f0401bbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Flow 'volume_create_manager' (da8d0d46-4e3d-4f38-9318-21965fffd03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-414a1dd9-25bd-418c-af85-399e9d8d41cc tempest-ProjectReaderTests-648879392 None] Created volume successfully.
Jul 07 23:01:17 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc.eeb0b77c-2013-4c05-af56-10e8560a4094" returned: 0 in 0.856s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-eeb0b77c-2013-4c05-af56-10e8560a4094" released by "_delete_snapshot" :: held 4.202s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" released by "delete_snapshot" :: held 4.232s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Created reservations ['10efe828-a830-4cf2-b77c-7136808b10fe', 'e376552b-ed26-4bbe-ac89-f40d4e0e070b', '516d1949-85d1-4b12-ab5e-c3f566a4aeaa', '05a73918-8f55-4414-90dd-00dae90cb609'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:17 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD
Jul 07 23:01:17 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Delete snapshot completed successfully.
Jul 07 23:01:17 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4a574fc0-8460-447c-8265-32e44ff16941 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-eeb0b77c-2013-4c05-af56-10e8560a4094-delete_snapshot" released by "delete_snapshot" :: held 4.415s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Acquiring lock "cinder-58ff1cea-661b-455a-9a61-54e5340c0204-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "cinder-58ff1cea-661b-455a-9a61-54e5340c0204-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Acquiring lock "cinder-quobyte-58ff1cea-661b-455a-9a61-54e5340c0204" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "cinder-quobyte-58ff1cea-661b-455a-9a61-54e5340c0204" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3b5127-f524-4511-9ace-5fe62ba4ada4]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:18 devstack sudo[107812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204
Jul 07 23:01:18 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96" returned: 0 in 0.890s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:18 devstack sudo[107815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96
Jul 07 23:01:18 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD" returned: 1 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] edecd74c-8ca7-41de-830b-5c52d28fa4e0 was raw, converting to raw {{(pid=88152) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:18 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:18 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-56961199-baf5-4cca-a7f3-a43629662bcc-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-56961199-baf5-4cca-a7f3-a43629662bcc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" acquired by "delete_volume" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd986935-d583-4eba-9d4a-2e2166e5c521]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204" returned: 0 in 0.853s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204
Jul 07 23:01:19 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack sudo[107825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:01:19 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0ae698ec-0c8f-4fa6-9422-2129374a6d96" returned: 0 in 0.769s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-0ae698ec-0c8f-4fa6-9422-2129374a6d96" released by "delete_volume" :: held 1.703s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['d575907c-2816-48b1-93f9-8881dd76319f', 'd1dbd463-026a-4d1c-ba7d-d9d3de98e89f', 'e1c7810f-1803-4b91-915e-8464fe8e0f86', '2e23b48c-7b67-451b-8f02-edc2189569bd'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:19 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 0 in 0.875s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edecd74c-8ca7-41de-830b-5c52d28fa4e0_wxm5w_d5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:01:19 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Converted 0.00 MB image at 0.00 MB/s
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1G
Jul 07 23:01:19 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-401a8107-3911-4fac-994f-772fc52b849f-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-401a8107-3911-4fac-994f-772fc52b849f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-401a8107-3911-4fac-994f-772fc52b849f" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-401a8107-3911-4fac-994f-772fc52b849f" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleting offline snapshot 401a8107-3911-4fac-994f-772fc52b849f of volume 9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] snapshot_file for this snap is: volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684506d-6d7b-4782-b532-cb9dbe3e62eb]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:19 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f
Jul 07 23:01:19 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-58ff1cea-661b-455a-9a61-54e5340c0204" returned: 0 in 0.956s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "cinder-quobyte-58ff1cea-661b-455a-9a61-54e5340c0204" released by "delete_volume" :: held 1.870s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:20 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 1.121s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.831s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:20 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc
Jul 07 23:01:20 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Created reservations ['fdbefacc-86c9-4946-a779-11bbb585e3cc', '0111dfc7-9a86-4e02-83f0-86e51d2225e3', 'bb6ef352-3d56-49b2-97b5-d203f68d5d76', '590c4410-d396-4e65-817b-a973189643b8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d9909458-3d7e-42e8-8052-4a4abc5da0b8 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-0ae698ec-0c8f-4fa6-9422-2129374a6d96-delete_volume" released by "delete_volume" :: held 2.825s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[107849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:20 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:20 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 1G" returned: 0 in 0.979s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee5e9a1-e572-4815-89a3-4d0dcd40146a]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:20 devstack sudo[107851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:20 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-56961199-baf5-4cca-a7f3-a43629662bcc" returned: 0 in 0.904s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f" returned: 0 in 1.209s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e93656d-0d72-4922-84da-b7cbba41168a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-56961199-baf5-4cca-a7f3-a43629662bcc" released by "delete_volume" :: held 2.123s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Flow 'volume_create_manager' (82971160-8525-4a3c-ace0-cf75f882afb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20e03fc-2fd5-4062-8fcb-3db46c385d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec47258a-2b2d-42c8-b960-946a54cf1df9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c20e03fc-2fd5-4062-8fcb-3db46c385d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363316022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9c3b47-c4f5-45d5-b81f-702065ab2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2969bef8e16640ab9ed1758c3b373e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:21Z,use_quota=True,user_id='3960b3bbc49547258da9c6fdd1c0ef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe7c17-e45a-4bce-9828-ac67c37fffe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dbe7c17-e45a-4bce-9828-ac67c37fffe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98be2cae-ceff-44c9-9503-ae3b92283ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98be2cae-ceff-44c9-9503-ae3b92283ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e9c3b47-c4f5-45d5-b81f-702065ab2fd1', 'volume_name': 'volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb77cfb6-1398-4e7f-aecc-c228c8ae7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb77cfb6-1398-4e7f-aecc-c228c8ae7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e15272-e971-4121-9c04-328a83422368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:21 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Volume 9e9c3b47-c4f5-45d5-b81f-702065ab2fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1', 'volume_size': 1}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-363316022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e9c3b47-c4f5-45d5-b81f-702065ab2fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2969bef8e16640ab9ed1758c3b373e15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:21Z,use_quota=True,user_id='3960b3bbc49547258da9c6fdd1c0ef11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Creating volume 9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:21 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:21 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.921s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:21 devstack sudo[107859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 1073741824
Jul 07 23:01:21 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Deleted volume successfully.
Jul 07 23:01:21 devstack sudo[107858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a
Jul 07 23:01:21 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-97e82802-46cd-4f4e-8602-e92b191d6ea0 tempest-ProjectReaderTests-648879392 None] Lock "cinder-58ff1cea-661b-455a-9a61-54e5340c0204-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Created reservations ['43ac6bf4-ca18-4b78-b8ba-68915231ec5c', '12c09480-5ead-435b-8d65-9908877a5be7', 'b61e4b1e-8599-4d8f-bf23-fc373fa2d64f', '0c215638-3e3d-4c61-af38-a7490ec89ec8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:21 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:21 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 0 in 1.095s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:21 devstack sudo[107866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:21 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a" returned: 0 in 0.956s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f
Jul 07 23:01:22 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 1073741824" returned: 0 in 0.986s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Deleted volume successfully.
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ba5afca8-a96e-4f5b-8404-a47954a69cda tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-56961199-baf5-4cca-a7f3-a43629662bcc-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-90029820-3875-41e9-8240-9231409441a9-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:22 devstack sudo[107878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1
Jul 07 23:01:22 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-90029820-3875-41e9-8240-9231409441a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad67a5e5-abb3-443a-9296-f0cd189592d1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9
Jul 07 23:01:22 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:22 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 1 in 0.997s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Downloaded image edecd74c-8ca7-41de-830b-5c52d28fa4e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}])) to volume d0697cec-8c18-4a4d-82a7-b66218b7ef41 successfully. {{(pid=88152) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Temporary image edecd74c-8ca7-41de-830b-5c52d28fa4e0 for user e841294c4cf2438998aab73fb5186abd is deleted. {{(pid=88152) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.volume_utils [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Marking volume d0697cec-8c18-4a4d-82a7-b66218b7ef41 as bootable. {{(pid=88152) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Copying metadata from image edecd74c-8ca7-41de-830b-5c52d28fa4e0 to d0697cec-8c18-4a4d-82a7-b66218b7ef41. {{(pid=88152) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Creating volume glance metadata for volume d0697cec-8c18-4a4d-82a7-b66218b7ef41 backed by image edecd74c-8ca7-41de-830b-5c52d28fa4e0 with: {'image_id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ca3ad230a9b2813c90d40a9bb1eef10', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88152) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83888869-d31d-4fa2-a854-c538c0fabe21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41', 'volume_size': 1, 'image_id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca3ad230a9b2813c90d40a9bb1eef10', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '46a29a4921f045d8b915caab475d253d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '89871b8efef0027e02fed74ccda91cb1b74e79502ae53f2e676a66bcd364e007f34487a9c8eb6926fd825080034433d32f1fcd2498b15383030829e74a35377e', 'id': 'edecd74c-8ca7-41de-830b-5c52d28fa4e0', 'created_at': datetime.datetime(2026, 7, 7, 21, 0, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 21, 0, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edecd74c-8ca7-41de-830b-5c52d28fa4e0/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x76fe7413a6f0>}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d3f70e-b426-4036-840e-b8eb99b0cdfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:22 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Volume volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 (d0697cec-8c18-4a4d-82a7-b66218b7ef41): created successfully
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d3f70e-b426-4036-840e-b8eb99b0cdfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Flow 'volume_create_manager' (099a3448-45d9-41d9-b7ae-37d9c7f5fd09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:22 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8a9fdd69-be67-4a76-9c32-eaef32e99407 tempest-VolumeImageDependencyTests-1494773778 None] Created volume successfully.
Jul 07 23:01:22 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f" returned: 0 in 0.883s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:22 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f
Jul 07 23:01:22 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:23 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64e15272-e971-4121-9c04-328a83422368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7befcd56-d9af-4aa9-8983-f3a7d0271517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Volume volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 (9e9c3b47-c4f5-45d5-b81f-702065ab2fd1): created successfully
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7befcd56-d9af-4aa9-8983-f3a7d0271517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Flow 'volume_create_manager' (82971160-8525-4a3c-ace0-cf75f882afb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2888a8c8-5a94-4edf-82ea-24e6db069b1f tempest-ProjectReaderTests-648879392 None] Created volume successfully.
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Acquiring lock "cinder-d0697cec-8c18-4a4d-82a7-b66218b7ef41-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:23 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "cinder-d0697cec-8c18-4a4d-82a7-b66218b7ef41-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9" returned: 0 in 0.889s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:23 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9
Jul 07 23:01:23 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Acquiring lock "cinder-quobyte-d0697cec-8c18-4a4d-82a7-b66218b7ef41" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "cinder-quobyte-d0697cec-8c18-4a4d-82a7-b66218b7ef41" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bee2cb-c7d6-4e36-a041-cee2e8ceae1f]: (4, 'raw') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:23 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:23 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:23 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a.401a8107-3911-4fac-994f-772fc52b849f" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-401a8107-3911-4fac-994f-772fc52b849f" released by "_delete_snapshot" :: held 3.968s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" released by "delete_snapshot" :: held 4.005s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['d394a42b-45a1-42ad-b1d4-5e51a0239316', '46aee2d3-4751-415f-b881-585181553cab', '71045647-d551-48f1-9003-ac84f0e35488', '7a8c6b75-3dcf-4936-be24-5791be1127c4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Delete snapshot completed successfully.
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-04031af2-12da-4c03-8a7e-9e3f1df3ff12 tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-401a8107-3911-4fac-994f-772fc52b849f-delete_snapshot" released by "delete_snapshot" :: held 4.194s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-9e93656d-0d72-4922-84da-b7cbba41168a-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-9e93656d-0d72-4922-84da-b7cbba41168a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:24 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-90029820-3875-41e9-8240-9231409441a9" returned: 0 in 0.763s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-quobyte-90029820-3875-41e9-8240-9231409441a9" released by "delete_volume" :: held 1.703s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[428b32d3-c302-48b0-90ad-4686b9c0bb29]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Created reservations ['405eb29f-5bfd-41fa-8483-c74a420ab2d7', 'e1bf2260-99a6-4f51-9f88-1aa63fd804b6', '44bf59a2-1027-4ccc-b26d-d71f46abb53f', 'd817b0b8-24b8-419c-a02d-1a6e8950ef50'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:24 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a
Jul 07 23:01:24 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:24 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Acquiring lock "cinder-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "cinder-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:24 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 0 in 0.902s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Acquiring lock "cinder-quobyte-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "cinder-quobyte-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[1570230e-7b79-42a5-990a-1ffe19b2b273]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:24 devstack sudo[107906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:24 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:24 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1
Jul 07 23:01:24 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Deleted volume successfully.
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-90835f36-d538-448b-b2c9-dc7fdaae3219 tempest-VolumeDependencyTests-1795720527 None] Lock "cinder-90029820-3875-41e9-8240-9231409441a9-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:25 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a" returned: 0 in 1.071s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:25 devstack sudo[107916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a
Jul 07 23:01:25 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 1 in 0.956s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41' failed. Not Retrying. {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:25 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41
Jul 07 23:01:25 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" returned: 0 in 1.166s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:25 devstack sudo[107924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1
Jul 07 23:01:25 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:25 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e93656d-0d72-4922-84da-b7cbba41168a" returned: 0 in 0.813s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-quobyte-9e93656d-0d72-4922-84da-b7cbba41168a" released by "delete_volume" :: held 1.966s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Created reservations ['436d2b79-d456-4e17-b512-63d4e5441bd3', '01b744e7-2225-4b31-aa30-0bc3a5d216f2', 'ba33c648-8cb8-4946-9c62-67ae979425a4', '85593cca-f8e6-44c3-9f5f-fcb8a2ba7909'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:26 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d0697cec-8c18-4a4d-82a7-b66218b7ef41" returned: 0 in 0.858s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "cinder-quobyte-d0697cec-8c18-4a4d-82a7-b66218b7ef41" released by "delete_volume" :: held 2.820s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:26 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:26 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Created reservations ['0f3379f2-96c0-4a9d-b4e1-f3e5b56fa008', 'e9fdb1c5-42da-4079-a8bb-ffaaf778fe48', '41f8843b-5ced-4717-992f-439012b517bc', 'e128c8f8-b2be-4918-8d8f-ed7e9d9c56b8'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:26 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:26 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:26 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" returned: 0 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "cinder-quobyte-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1" released by "delete_volume" :: held 2.095s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Created reservations ['f08abb4c-947c-4ea6-ae1e-7e36fa654ea5', '76f41f3e-6f35-4aad-a1d2-46c5917c18a3', '09e67960-8a2e-4bb9-9d11-fa8b04904443', '16cf9d50-95e5-45dd-88a7-dff2fdf5e0dc'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:26 devstack sudo[107934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:26 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:27 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.258s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Deleted volume successfully.
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7c2adfec-1693-4715-be65-f4586dfbc42c tempest-CreateVolumesFromSnapshotTest-189927989 None] Lock "cinder-9e93656d-0d72-4922-84da-b7cbba41168a-delete_volume" released by "delete_volume" :: held 3.505s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:27 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.103s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Deleted volume successfully.
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-31a54fa1-6d15-45e4-a679-c637d955c71c tempest-VolumeImageDependencyTests-1494773778 None] Lock "cinder-d0697cec-8c18-4a4d-82a7-b66218b7ef41-delete_volume" released by "delete_volume" :: held 4.268s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:27 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.183s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:27 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Deleted volume successfully.
Jul 07 23:01:28 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-9938b04d-35f2-42bb-8f62-2c500bb68815 tempest-ProjectReaderTests-648879392 None] Lock "cinder-9e9c3b47-c4f5-45d5-b81f-702065ab2fd1-delete_volume" released by "delete_volume" :: held 3.703s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:33 devstack sudo[107939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:33 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (63e35c98-3605-478b-884a-d37a7b143e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e23cdd-60da-4b83-8b35-ab041fb34233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8e23cdd-60da-4b83-8b35-ab041fb34233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875609274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7416ae-dc33-45de-b267-c38c5001d182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:34Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69dc164-e82e-4fc8-8a29-39feab63bbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c69dc164-e82e-4fc8-8a29-39feab63bbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6cd9b2-7dd0-4fda-91fc-fe813258b381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6cd9b2-7dd0-4fda-91fc-fe813258b381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7416ae-dc33-45de-b267-c38c5001d182', 'volume_name': 'volume-6d7416ae-dc33-45de-b267-c38c5001d182', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c17dbc5-f1af-49f5-b340-6e2696d5d70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c17dbc5-f1af-49f5-b340-6e2696d5d70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be71046f-8d2a-4553-aa86-45fc260d0683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:34 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Volume 6d7416ae-dc33-45de-b267-c38c5001d182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7416ae-dc33-45de-b267-c38c5001d182', 'volume_size': 1}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-875609274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7416ae-dc33-45de-b267-c38c5001d182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:34Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Creating volume 6d7416ae-dc33-45de-b267-c38c5001d182 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:34 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:34 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 1073741824
Jul 07 23:01:34 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:34 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.772s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:01:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:01:35 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 1073741824" returned: 0 in 1.108s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:35 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182
Jul 07 23:01:35 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:36 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182" returned: 0 in 0.901s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be71046f-8d2a-4553-aa86-45fc260d0683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7416ae-dc33-45de-b267-c38c5001d182', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856499d8-7ae7-4acd-8191-d6b12094c1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:36 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Volume volume-6d7416ae-dc33-45de-b267-c38c5001d182 (6d7416ae-dc33-45de-b267-c38c5001d182): created successfully
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856499d8-7ae7-4acd-8191-d6b12094c1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:36 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (63e35c98-3605-478b-884a-d37a7b143e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-34d7f8d0-5a96-4e02-8ff6-f376d206cc7a tempest-ProjectReaderTests-1502966368 None] Created volume successfully.
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-6d7416ae-dc33-45de-b267-c38c5001d182-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "cinder-6d7416ae-dc33-45de-b267-c38c5001d182-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-quobyte-6d7416ae-dc33-45de-b267-c38c5001d182" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-6d7416ae-dc33-45de-b267-c38c5001d182" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68a490a-e2a6-42c1-b41e-d9d51c6c2a62]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:37 devstack sudo[107952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182
Jul 07 23:01:37 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:38 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182" returned: 0 in 0.934s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:38 devstack sudo[107957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182
Jul 07 23:01:38 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (f91c803c-3875-4159-8762-4bf2e55f7d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:39 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a7cbe2-53cf-459f-90f3-0d3bc5e4eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d7416ae-dc33-45de-b267-c38c5001d182" returned: 0 in 0.915s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17a7cbe2-53cf-459f-90f3-0d3bc5e4eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-763115630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfaa32f-579f-4e38-b5c3-68a3a5cca58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:39Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b082f1-6779-4b0f-ba4e-7c137b516694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70b082f1-6779-4b0f-ba4e-7c137b516694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3447de-8405-4c65-9b42-ffffc31b9e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3447de-8405-4c65-9b42-ffffc31b9e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bfaa32f-579f-4e38-b5c3-68a3a5cca58e', 'volume_name': 'volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60599f9b-08c8-4d95-adb8-0eda0723c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60599f9b-08c8-4d95-adb8-0eda0723c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bd8048-6333-4eac-be40-7fc9f39dc18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Volume 7bfaa32f-579f-4e38-b5c3-68a3a5cca58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e', 'volume_size': 1}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-763115630',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bfaa32f-579f-4e38-b5c3-68a3a5cca58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:39Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Creating volume 7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-6d7416ae-dc33-45de-b267-c38c5001d182" released by "delete_volume" :: held 1.982s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:39 devstack sudo[107966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e 1073741824
Jul 07 23:01:39 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Created reservations ['67efc7f1-85c0-4244-8a1c-d2a5772690a8', 'e5b1442d-5307-49c4-b549-64667dac61ea', 'a24713cc-f2b4-42c3-b914-748e36d6c7c6', '999b7305-5698-4c32-ba6c-1f38634d3843'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:39 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:39 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (60166fe7-99eb-462e-82f0-46595c671279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9dd95-513a-47b2-9fc8-1ce18f38a101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01d9dd95-513a-47b2-9fc8-1ce18f38a101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740853970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e6a8b2-1309-465e-bed4-0c3407f41a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:41Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:40 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c90e8a9-2c7f-463a-a008-ac82db234ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c90e8a9-2c7f-463a-a008-ac82db234ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4771cb-9c7b-42d4-a283-a5ecf10a712b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4771cb-9c7b-42d4-a283-a5ecf10a712b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e6a8b2-1309-465e-bed4-0c3407f41a9c', 'volume_name': 'volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc66f71-3683-4f67-8b9d-ae9a1ed5dbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc66f71-3683-4f67-8b9d-ae9a1ed5dbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9ffce2-6350-468c-b8a0-b427b634c35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Volume 99e6a8b2-1309-465e-bed4-0c3407f41a9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c', 'volume_size': 1}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 1.160s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:40 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Deleted volume successfully.
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-8fd24d13-1515-44f8-b5e5-90757b1fbe8a tempest-ProjectReaderTests-1502966368 None] Lock "cinder-6d7416ae-dc33-45de-b267-c38c5001d182-delete_volume" released by "delete_volume" :: held 3.449s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:40 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e 1073741824" returned: 0 in 1.461s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:41 devstack sudo[107974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e
Jul 07 23:01:41 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:41 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" returned: 0 in 0.691s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.836s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-740853970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e6a8b2-1309-465e-bed4-0c3407f41a9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:41Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Creating volume 99e6a8b2-1309-465e-bed4-0c3407f41a9c {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:41 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:41 devstack sudo[107977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c 1073741824
Jul 07 23:01:41 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01bd8048-6333-4eac-be40-7fc9f39dc18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3b86e-373f-4dfa-a185-530fa5296e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Volume volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e (7bfaa32f-579f-4e38-b5c3-68a3a5cca58e): created successfully
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a3b86e-373f-4dfa-a185-530fa5296e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (f91c803c-3875-4159-8762-4bf2e55f7d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c5433e29-45d6-4fc0-9a9c-8e0fcdb9fc59 tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:01:42 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c 1073741824" returned: 0 in 0.898s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:42 devstack sudo[107983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c
Jul 07 23:01:42 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:43 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c" returned: 0 in 0.675s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.297s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9ffce2-6350-468c-b8a0-b427b634c35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77df2e33-d82a-4826-9935-67947109ca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot a9a4100e-5041-40fc-a617-416e03384f44 of volume 7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:01:43 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Volume volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c (99e6a8b2-1309-465e-bed4-0c3407f41a9c): created successfully
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77df2e33-d82a-4826-9935-67947109ca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (60166fe7-99eb-462e-82f0-46595c671279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea16d782-2226-4611-b28b-e01f63def4d9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:43 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c82f7198-4c60-4e77-a62e-92092d1d694e tempest-ProjectReaderTests-1502966368 None] Created volume successfully.
Jul 07 23:01:43 devstack sudo[107986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e
Jul 07 23:01:43 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-99e6a8b2-1309-465e-bed4-0c3407f41a9c-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-99e6a8b2-1309-465e-bed4-0c3407f41a9c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-quobyte-99e6a8b2-1309-465e-bed4-0c3407f41a9c" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:43 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-99e6a8b2-1309-465e-bed4-0c3407f41a9c" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ae4242-a590-4293-b8e6-cd14fd8b249b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:44 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c
Jul 07 23:01:44 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:44 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" returned: 0 in 0.827s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:44 devstack sudo[107993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 1G
Jul 07 23:01:44 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:44 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c" returned: 0 in 0.883s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:44 devstack sudo[108001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c
Jul 07 23:01:44 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:45 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 1G" returned: 0 in 0.900s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:45 devstack sudo[108004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44
Jul 07 23:01:45 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:45 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-99e6a8b2-1309-465e-bed4-0c3407f41a9c" returned: 0 in 0.738s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-99e6a8b2-1309-465e-bed4-0c3407f41a9c" released by "delete_volume" :: held 1.693s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Created reservations ['ef37e423-5c60-42a9-8190-5e27a7b05e6f', 'd1093953-3375-4c11-a4f0-ddcde7ae98c9', '90dc0943-d65a-43f1-b7a8-822aa0fe0865', 'fe2ae9de-e8e5-47a6-8a13-f726eae6bdeb'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:45 devstack sudo[108010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:45 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:45 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44" returned: 0 in 0.852s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 is being set with open permissions: ugo+rw
Jul 07 23:01:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:46 devstack sudo[108012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44
Jul 07 23:01:46 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:46 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.813s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Deleted volume successfully.
Jul 07 23:01:46 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (dccf07cd-fcce-4155-a1c9-ce3ea15938b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82e2181-7898-4407-88fe-b6e801579ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-93e72001-2f63-4338-b696-c8af592cd942 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-99e6a8b2-1309-465e-bed4-0c3407f41a9c-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44" returned: 0 in 0.782s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82e2181-7898-4407-88fe-b6e801579ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161458081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0355fada-fab5-4770-b7d8-1136d615b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:47Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dcdda8-3a19-43db-a9a3-6c11bb304b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3dcdda8-3a19-43db-a9a3-6c11bb304b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec49ccb-9df5-4f65-afd9-029116c7d7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec49ccb-9df5-4f65-afd9-029116c7d7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0355fada-fab5-4770-b7d8-1136d615b582', 'volume_name': 'volume-0355fada-fab5-4770-b7d8-1136d615b582', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e7dc9f-878e-4a73-a219-9b27d79046d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e7dc9f-878e-4a73-a219-9b27d79046d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dffb81-3a4c-47ca-8097-c33fb17433f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:46 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Volume 0355fada-fab5-4770-b7d8-1136d615b582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0355fada-fab5-4770-b7d8-1136d615b582', 'volume_size': 1}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:46 devstack sudo[108017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info
Jul 07 23:01:46 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:47 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info" returned: 0 in 0.686s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:47 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info is being set with open permissions: ugo+rw
Jul 07 23:01:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:47 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info
Jul 07 23:01:47 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:48 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.info" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.914s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1161458081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0355fada-fab5-4770-b7d8-1136d615b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:47Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Creating volume 0355fada-fab5-4770-b7d8-1136d615b582 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:48 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:48 devstack sudo[108023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 1073741824
Jul 07 23:01:48 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-aff35991-5bf4-488b-b37b-d41868fb4df4 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:01:49 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 1073741824" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:49 devstack sudo[108029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582
Jul 07 23:01:49 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-a9a4100e-5041-40fc-a617-416e03384f44-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-a9a4100e-5041-40fc-a617-416e03384f44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-a9a4100e-5041-40fc-a617-416e03384f44" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-a9a4100e-5041-40fc-a617-416e03384f44" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot a9a4100e-5041-40fc-a617-416e03384f44 of volume 7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e1aac-5072-4d2c-91de-6aa8ac38b008]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:49 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44
Jul 07 23:01:49 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:49 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dffb81-3a4c-47ca-8097-c33fb17433f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0355fada-fab5-4770-b7d8-1136d615b582', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480ba338-dec7-42de-9e0a-bfd0bd404c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:49 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Volume volume-0355fada-fab5-4770-b7d8-1136d615b582 (0355fada-fab5-4770-b7d8-1136d615b582): created successfully
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480ba338-dec7-42de-9e0a-bfd0bd404c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:49 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (dccf07cd-fcce-4155-a1c9-ce3ea15938b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:49 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-12b57b5b-9109-40ef-bf26-3e1facc80964 tempest-ProjectReaderTests-1502966368 None] Created volume successfully.
Jul 07 23:01:50 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44" returned: 0 in 0.753s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:50 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:01:50 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f145278f-dee3-4c3c-9c67-2ef805f4be4f]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:50 devstack sudo[108037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e
Jul 07 23:01:50 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-0355fada-fab5-4770-b7d8-1136d615b582-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:51 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "cinder-0355fada-fab5-4770-b7d8-1136d615b582-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" returned: 0 in 0.859s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:51 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44
Jul 07 23:01:51 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-quobyte-0355fada-fab5-4770-b7d8-1136d615b582" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-0355fada-fab5-4770-b7d8-1136d615b582" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[725a6005-9ee4-4a28-85b3-1b0d18e5f6e0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:51 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582
Jul 07 23:01:51 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:51 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44" returned: 0 in 0.747s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:51 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44
Jul 07 23:01:51 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:51 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582" returned: 0 in 0.764s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:51 devstack sudo[108054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582
Jul 07 23:01:51 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:52 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e.a9a4100e-5041-40fc-a617-416e03384f44" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-a9a4100e-5041-40fc-a617-416e03384f44" released by "_delete_snapshot" :: held 3.147s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" released by "delete_snapshot" :: held 3.173s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:52 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-0355fada-fab5-4770-b7d8-1136d615b582" returned: 0 in 0.637s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-0355fada-fab5-4770-b7d8-1136d615b582" released by "delete_volume" :: held 1.439s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Created reservations ['841841df-acaf-4c2b-a5bf-9fe17a7932a2', 'cac7c464-2284-4fec-a348-f2907bb9285e', 'e263ab25-e2f7-4f79-aff4-c182367eea4f', '681445f9-2845-4243-98ff-816a00ac62f1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Created reservations ['ecb68839-f30c-49cc-987c-657c9643c9c7', '6e785a26-2454-4ed8-8aad-8baa3e53b5b9', '7678a6a6-7ff9-4f11-b5c4-165c96a84fc1', 'ce243024-b368-4ddc-ab81-af60bd641a11'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2e8b3edf-9b13-4e8d-990d-3b844c890574 tempest-ProjectMemberTests-855905026 None] Lock "cinder-a9a4100e-5041-40fc-a617-416e03384f44-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:52 devstack sudo[108058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:52 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:53 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Deleted volume successfully.
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-35b00546-72a6-468e-95ae-5e6cb9905b4d tempest-ProjectReaderTests-1502966368 None] Lock "cinder-0355fada-fab5-4770-b7d8-1136d615b582-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "cinder-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a68b9f-aa90-4d4d-8082-fab7fdab56e3]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (9f280557-5445-4958-812f-051887f8d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcad5d9-b9a1-4fde-8f28-75d363cab6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:53 devstack sudo[108061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e
Jul 07 23:01:53 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcad5d9-b9a1-4fde-8f28-75d363cab6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555379399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a426a9ee-d7cb-4b22-825d-3c04c1c05407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:54Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa13bc31-d77b-49bb-95cb-5446a862f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa13bc31-d77b-49bb-95cb-5446a862f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b8e191-17fe-4fba-9d15-fadc169d97e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61b8e191-17fe-4fba-9d15-fadc169d97e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a426a9ee-d7cb-4b22-825d-3c04c1c05407', 'volume_name': 'volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c2e2f7-2d50-49eb-84cc-24387064adbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c2e2f7-2d50-49eb-84cc-24387064adbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4aa033-2ea9-4615-8dce-5164c906973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:53 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Volume a426a9ee-d7cb-4b22-825d-3c04c1c05407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407', 'volume_size': 1}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1555379399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a426a9ee-d7cb-4b22-825d-3c04c1c05407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44a8720ff2aa40c38d6755e7916574e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:54Z,use_quota=True,user_id='2b6e17edde6741fc85a677a6705aa854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Creating volume a426a9ee-d7cb-4b22-825d-3c04c1c05407 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:53 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:53 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 1073741824
Jul 07 23:01:53 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:54 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" returned: 0 in 0.743s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:54 devstack sudo[108068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e
Jul 07 23:01:54 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:54 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 1073741824" returned: 0 in 0.930s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=161,cinder:SELECT=116,cinder:INSERT=51,cinder:DELETE=13 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=120,cinder:UPDATE=175,cinder:DELETE=15,cinder:INSERT=39 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:01:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:54 devstack sudo[108073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407
Jul 07 23:01:54 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:55 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" returned: 0 in 0.687s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e" released by "delete_volume" :: held 1.511s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Created reservations ['a763662f-d9fd-4208-b616-1d94f722ddfd', '64d2af19-6575-4fb1-9094-b809bd2f293e', '335e4dbf-65ba-4aa3-be4d-eeb8afb371b1', '450a5533-25b9-468a-8ddf-16a896a56c99'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:55 devstack sudo[108077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:55 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:55 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4aa033-2ea9-4615-8dce-5164c906973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cec97e-e864-4c92-9d2a-9de5c5a926bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:55 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Volume volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 (a426a9ee-d7cb-4b22-825d-3c04c1c05407): created successfully
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8cec97e-e864-4c92-9d2a-9de5c5a926bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Flow 'volume_create_manager' (9f280557-5445-4958-812f-051887f8d326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:55 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-006a0625-d7b7-4cf5-a108-fa035f557656 tempest-ProjectReaderTests-1502966368 None] Created volume successfully.
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-a426a9ee-d7cb-4b22-825d-3c04c1c05407-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:55 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-a426a9ee-d7cb-4b22-825d-3c04c1c05407-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "cinder-quobyte-a426a9ee-d7cb-4b22-825d-3c04c1c05407" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-a426a9ee-d7cb-4b22-825d-3c04c1c05407" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:01:56 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.742s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[036be3a7-8627-4e3d-a74a-6a1b073972ac]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-eec8d744-19cf-4e57-a2f6-1578e891e32f tempest-ProjectMemberTests-855905026 None] Lock "cinder-7bfaa32f-579f-4e38-b5c3-68a3a5cca58e-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:56 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407
Jul 07 23:01:56 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (91b1ae63-3c93-4647-993f-a0f2a7b27ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97276918-1298-4d4c-a00f-e367f9a7cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97276918-1298-4d4c-a00f-e367f9a7cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402034069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0717aa-3cd1-4dcb-9411-1495779b5964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:56Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b5ca23-966a-43f1-9e45-c7c61d2f6058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b5ca23-966a-43f1-9e45-c7c61d2f6058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6681736c-8aa1-4e0a-9e25-3f36091fe4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6681736c-8aa1-4e0a-9e25-3f36091fe4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0717aa-3cd1-4dcb-9411-1495779b5964', 'volume_name': 'volume-be0717aa-3cd1-4dcb-9411-1495779b5964', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4575c0e6-02eb-462a-8449-8cffb1d5f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4575c0e6-02eb-462a-8449-8cffb1d5f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335ef3e8-6879-4716-bb49-c4515cfc0ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Volume be0717aa-3cd1-4dcb-9411-1495779b5964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0717aa-3cd1-4dcb-9411-1495779b5964', 'volume_size': 1}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402034069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0717aa-3cd1-4dcb-9411-1495779b5964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:01:56Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Creating volume be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:01:56 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:56 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 1073741824
Jul 07 23:01:56 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:56 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407" returned: 0 in 0.774s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:56 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407
Jul 07 23:01:56 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:57 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 1073741824" returned: 0 in 0.877s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:57 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964
Jul 07 23:01:57 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:57 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-a426a9ee-d7cb-4b22-825d-3c04c1c05407" returned: 0 in 0.661s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-quobyte-a426a9ee-d7cb-4b22-825d-3c04c1c05407" released by "delete_volume" :: held 1.492s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Created reservations ['a3db4280-1fce-4f61-909d-371f75206d3e', '728fc75d-7833-4cd8-afd5-1505be2744e6', 'd8bb2265-d01b-4994-a01f-447da221e5eb', 'a93a5c38-5e3d-4428-a81d-a5123b62cc38'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:57 devstack sudo[108097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:01:57 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:58 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964" returned: 0 in 0.660s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (335ef3e8-6879-4716-bb49-c4515cfc0ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0717aa-3cd1-4dcb-9411-1495779b5964', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149c144a-54f0-4569-b4ab-e4386ffc0b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:01:58 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Volume volume-be0717aa-3cd1-4dcb-9411-1495779b5964 (be0717aa-3cd1-4dcb-9411-1495779b5964): created successfully
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149c144a-54f0-4569-b4ab-e4386ffc0b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (91b1ae63-3c93-4647-993f-a0f2a7b27ad5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:01:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3b77cd2f-88d0-4635-b0cd-bbf31041296f tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:01:58 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.661s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:01:58 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Deleted volume successfully.
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6a5b906e-1425-415f-aa36-303376ccb779 tempest-ProjectReaderTests-1502966368 None] Lock "cinder-a426a9ee-d7cb-4b22-825d-3c04c1c05407-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 7a3dc2f3-1882-4961-9643-aebabec43c5c of volume be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3425d65-924d-443a-86e0-fb0a16615fc1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:01:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:58 devstack sudo[108103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964
Jul 07 23:01:58 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:01:59 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root
Jul 07 23:01:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964" returned: 0 in 0.878s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:01:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:01:59 devstack sudo[108109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c 1G
Jul 07 23:01:59 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:00 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c 1G" returned: 0 in 0.884s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0717aa-3cd1-4dcb-9411-1495779b5964 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:00 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0717aa-3cd1-4dcb-9411-1495779b5964 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c
Jul 07 23:02:00 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:01 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0717aa-3cd1-4dcb-9411-1495779b5964 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:01 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c is being set with open permissions: ugo+rw
Jul 07 23:02:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:01 devstack sudo[108120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c
Jul 07 23:02:01 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:01 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c" returned: 0 in 0.637s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:01 devstack sudo[108123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info
Jul 07 23:02:01 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:02 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info" returned: 0 in 0.619s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:02 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info is being set with open permissions: ugo+rw
Jul 07 23:02:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:02 devstack sudo[108126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info
Jul 07 23:02:02 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:03 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.info" returned: 0 in 0.631s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.413s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-b64092bd-6157-426c-86ca-a914099d7141 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-7a3dc2f3-1882-4961-9643-aebabec43c5c-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-7a3dc2f3-1882-4961-9643-aebabec43c5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-7a3dc2f3-1882-4961-9643-aebabec43c5c" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7a3dc2f3-1882-4961-9643-aebabec43c5c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 7a3dc2f3-1882-4961-9643-aebabec43c5c of volume be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[013d6e44-b48d-4d2c-92d2-ece9e4754168]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:04 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c
Jul 07 23:02:04 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:04 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c" returned: 0 in 0.757s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0717aa-3cd1-4dcb-9411-1495779b5964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[79003b13-70e4-4b02-b22a-6e11e2879699]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:04 devstack sudo[108134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964
Jul 07 23:02:04 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:05 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964" returned: 0 in 0.739s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:05 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c
Jul 07 23:02:05 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:06 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c" returned: 0 in 0.761s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:06 devstack sudo[108144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c
Jul 07 23:02:06 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:07 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964.7a3dc2f3-1882-4961-9643-aebabec43c5c" returned: 0 in 0.812s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-7a3dc2f3-1882-4961-9643-aebabec43c5c" released by "_delete_snapshot" :: held 3.178s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" released by "delete_snapshot" :: held 3.203s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Created reservations ['28fe0ab1-d473-4daa-8b64-75aae6b17e27', 'dbcd89f5-6ea7-4b8c-92cc-8ee01eceaf95', '50a6be50-6fdb-4dc1-8260-c383f14ca83b', '559c5731-9b89-4ba8-be46-c07fee4f7757'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:02:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-5831fa6f-6bd8-4e96-afa9-7d71ed6639d8 tempest-ProjectMemberTests-855905026 None] Lock "cinder-7a3dc2f3-1882-4961-9643-aebabec43c5c-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-be0717aa-3cd1-4dcb-9411-1495779b5964-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "cinder-be0717aa-3cd1-4dcb-9411-1495779b5964-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72bcb94-d761-46c0-9ff1-0145afa44833]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:08 devstack sudo[108148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964
Jul 07 23:02:08 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:09 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964" returned: 0 in 0.773s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:09 devstack sudo[108153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964
Jul 07 23:02:09 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:09 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be0717aa-3cd1-4dcb-9411-1495779b5964" returned: 0 in 0.658s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-be0717aa-3cd1-4dcb-9411-1495779b5964" released by "delete_volume" :: held 1.491s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Created reservations ['2d660a89-5e0e-463f-a84d-82b3bee7bf73', '3204a368-e4a9-44ad-a0df-6043772b3be3', '39a75487-8aba-49a8-b47f-813332c12872', '4238f938-416a-4acd-8915-9a93ed5dad0e'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:09 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:02:09 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:10 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.722s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:10 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2a20f97c-e3fe-4d6c-a8f5-82544194c8b5 tempest-ProjectMemberTests-855905026 None] Lock "cinder-be0717aa-3cd1-4dcb-9411-1495779b5964-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (e403b0ee-5bbe-4fd9-a74a-d224dc165e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4d735d-63f6-4209-bfee-08789e0d3ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c4d735d-63f6-4209-bfee-08789e0d3ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902227741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35357306-bc62-4858-89b9-e4a7c3145e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:11Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be48ee1-32f8-450e-94b5-ed116c464b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be48ee1-32f8-450e-94b5-ed116c464b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551290c8-f9e3-45ea-8159-529c9556796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (551290c8-f9e3-45ea-8159-529c9556796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35357306-bc62-4858-89b9-e4a7c3145e3e', 'volume_name': 'volume-35357306-bc62-4858-89b9-e4a7c3145e3e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d89a17-3836-4639-99ff-9a0857e06f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d89a17-3836-4639-99ff-9a0857e06f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e6768-1be7-494e-9435-721296ed491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Volume 35357306-bc62-4858-89b9-e4a7c3145e3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35357306-bc62-4858-89b9-e4a7c3145e3e', 'volume_size': 1}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1902227741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35357306-bc62-4858-89b9-e4a7c3145e3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:11Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Creating volume 35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:10 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:02:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:10 devstack sudo[108195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e 1073741824
Jul 07 23:02:10 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:11 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e 1073741824" returned: 0 in 0.807s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:11 devstack sudo[108201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e
Jul 07 23:02:11 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:12 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e" returned: 0 in 0.648s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1e6768-1be7-494e-9435-721296ed491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35357306-bc62-4858-89b9-e4a7c3145e3e', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded3f1b4-9dd1-4527-9893-0d1b9175bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Volume volume-35357306-bc62-4858-89b9-e4a7c3145e3e (35357306-bc62-4858-89b9-e4a7c3145e3e): created successfully
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded3f1b4-9dd1-4527-9893-0d1b9175bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (e403b0ee-5bbe-4fd9-a74a-d224dc165e6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-fb00fe17-741b-4f72-87d1-aafc3c195aaa tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f of volume 35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[41986f61-8fcc-4bf0-a553-40b78f494819]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:13 devstack sudo[108204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e
Jul 07 23:02:13 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:13 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e" returned: 0 in 0.785s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:13 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f 1G
Jul 07 23:02:13 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:14 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f 1G" returned: 0 in 0.828s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35357306-bc62-4858-89b9-e4a7c3145e3e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:14 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35357306-bc62-4858-89b9-e4a7c3145e3e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f
Jul 07 23:02:14 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:15 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35357306-bc62-4858-89b9-e4a7c3145e3e -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" returned: 0 in 0.718s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:15 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f is being set with open permissions: ugo+rw
Jul 07 23:02:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:15 devstack sudo[108220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f
Jul 07 23:02:15 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:16 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" returned: 0 in 0.645s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:16 devstack sudo[108224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info
Jul 07 23:02:16 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info" returned: 0 in 0.660s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:16 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info is being set with open permissions: ugo+rw
Jul 07 23:02:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:16 devstack sudo[108228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info
Jul 07 23:02:16 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:17 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.info" returned: 0 in 0.648s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.374s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4a43fb34-1e0d-4676-99f4-06fc49ea38f2 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f of volume 35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[627c5860-8a7f-476f-8a8d-fbec6b091137]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:18 devstack sudo[108231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f
Jul 07 23:02:18 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:19 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" returned: 0 in 0.737s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35357306-bc62-4858-89b9-e4a7c3145e3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29968a9-14db-4c8c-9dca-29768984979e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:19 devstack sudo[108236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e
Jul 07 23:02:19 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:19 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e" returned: 0 in 0.779s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:19 devstack sudo[108241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f
Jul 07 23:02:19 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:20 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" returned: 0 in 0.718s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:20 devstack sudo[108246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f
Jul 07 23:02:20 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:21 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e.ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f" released by "_delete_snapshot" :: held 2.999s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" released by "delete_snapshot" :: held 3.022s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Created reservations ['e548c1cb-5c05-4735-a535-97ebda33352d', 'ab124a06-6907-4626-91f0-476f5d7d8601', 'ac3a13a0-c0bb-46fb-9480-de59f9011471', 'd008b1d2-b806-4fdf-a223-a05866a781dc'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:02:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a5c875a0-6eef-4c25-8879-01fbcc34df38 tempest-ProjectMemberTests-855905026 None] Lock "cinder-ed0aa6ee-4c51-4d50-ad76-5258b23bfc1f-delete_snapshot" released by "delete_snapshot" :: held 3.171s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-35357306-bc62-4858-89b9-e4a7c3145e3e-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "cinder-35357306-bc62-4858-89b9-e4a7c3145e3e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" acquired by "delete_volume" :: waited 0.014s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc133e9-27cc-4fb3-b105-44cbe62c5e6b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:22 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e
Jul 07 23:02:22 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:23 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e" returned: 0 in 0.783s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:23 devstack sudo[108254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e
Jul 07 23:02:23 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:24 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-35357306-bc62-4858-89b9-e4a7c3145e3e" returned: 0 in 0.671s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-35357306-bc62-4858-89b9-e4a7c3145e3e" released by "delete_volume" :: held 1.512s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Created reservations ['e5b5b5ac-cace-4e44-9b8b-5061a473d107', '7f849a74-41ab-49f3-b7d0-857e5562f9af', '1206d488-e4eb-486b-a003-737a3b3b4c74', 'bb9d53da-fe0f-4524-a755-9cbc7b7733ad'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:24 devstack sudo[108257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:02:24 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:24 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.641s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:24 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:02:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-63c6c016-7977-47f2-a02e-5759797dedfa tempest-ProjectMemberTests-855905026 None] Lock "cinder-35357306-bc62-4858-89b9-e4a7c3145e3e-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (1928b2f8-ed1d-457e-9bb4-4f5b59727877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8206d067-9c4c-4a7b-9339-e9d2ea891bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8206d067-9c4c-4a7b-9339-e9d2ea891bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225425601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e0f20a-1084-43c8-b9c9-53a7130f56ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:25Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5076a9cd-cc11-4313-8893-33a29b3a6cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5076a9cd-cc11-4313-8893-33a29b3a6cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd6cd52-966a-442f-a336-3de195fe2bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd6cd52-966a-442f-a336-3de195fe2bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e0f20a-1084-43c8-b9c9-53a7130f56ab', 'volume_name': 'volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea622de-e27c-49ce-9d1e-d720ebc0e903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea622de-e27c-49ce-9d1e-d720ebc0e903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b474845b-70c0-4881-870c-9277e26911be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Volume d9e0f20a-1084-43c8-b9c9-53a7130f56ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab', 'volume_size': 1}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1225425601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e0f20a-1084-43c8-b9c9-53a7130f56ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:25Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Creating volume d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:25 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:02:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:25 devstack sudo[108260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab 1073741824
Jul 07 23:02:25 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:26 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab 1073741824" returned: 0 in 0.864s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:26 devstack sudo[108266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab
Jul 07 23:02:26 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:26 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" returned: 0 in 0.656s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b474845b-70c0-4881-870c-9277e26911be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e0b469-c7ac-49f2-8b68-7d5c0366c803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:27 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Volume volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab (d9e0f20a-1084-43c8-b9c9-53a7130f56ab): created successfully
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e0b469-c7ac-49f2-8b68-7d5c0366c803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (1928b2f8-ed1d-457e-9bb4-4f5b59727877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:27 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5bba8dde-c233-47a4-a59d-79dd1497f09b tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 of volume d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9e0f38-c856-4f45-9b02-fb196c7bfbce]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:27 devstack sudo[108269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab
Jul 07 23:02:27 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:28 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" returned: 0 in 0.759s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:28 devstack sudo[108274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 1G
Jul 07 23:02:28 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:29 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 1G" returned: 0 in 0.798s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:29 devstack sudo[108280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4
Jul 07 23:02:29 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:29 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:29 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 is being set with open permissions: ugo+rw
Jul 07 23:02:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:29 devstack sudo[108285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4
Jul 07 23:02:29 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:30 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" returned: 0 in 0.648s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:30 devstack sudo[108288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info
Jul 07 23:02:30 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:31 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info" returned: 0 in 0.665s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:31 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info is being set with open permissions: ugo+rw
Jul 07 23:02:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:31 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info
Jul 07 23:02:31 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:31 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.info" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.337s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:31 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-cfb6509c-c67d-4a8d-863b-0fabe61c0996 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 of volume d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac4d3c4-d6f9-490f-85fa-68e1dd248a6d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:33 devstack sudo[108294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4
Jul 07 23:02:33 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:33 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" returned: 0 in 0.738s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0f2a76-e7f1-4129-8bb1-07a7303a025b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:33 devstack sudo[108299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab
Jul 07 23:02:33 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:33 devstack sudo[108301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:02:33 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:34 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" returned: 0 in 0.765s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:34 devstack sudo[108306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4
Jul 07 23:02:34 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:34 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:02:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:02:35 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" returned: 0 in 0.772s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:35 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4
Jul 07 23:02:35 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:35 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab.970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" returned: 0 in 0.630s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4" released by "_delete_snapshot" :: held 2.993s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" released by "delete_snapshot" :: held 3.014s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:35 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Created reservations ['49cbb20b-870c-411b-b4a5-6b98b54fff82', 'b824260d-af81-46dc-9a0b-c5815a2c40ff', 'fccd5a15-733c-4b77-a565-f2c83919afba', 'acb163b9-38d6-4655-8f1c-717f7f21cc47'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:02:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-29ce9edb-f06d-46f5-8245-94353a34a72a tempest-ProjectMemberTests-855905026 None] Lock "cinder-970871ae-f9ab-4d7e-ba17-d5c6c9b603c4-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-d9e0f20a-1084-43c8-b9c9-53a7130f56ab-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "cinder-d9e0f20a-1084-43c8-b9c9-53a7130f56ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f6fb4e-74b1-42fd-b941-e04caa51a93c]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:37 devstack sudo[108316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab
Jul 07 23:02:37 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:37 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:37 devstack sudo[108321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab
Jul 07 23:02:37 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:38 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" returned: 0 in 0.668s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-d9e0f20a-1084-43c8-b9c9-53a7130f56ab" released by "delete_volume" :: held 1.520s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Created reservations ['9661e7b7-ae12-4656-9d86-22a350c1638a', '2463f248-32e6-44e8-9f43-6f6ff217b4f9', '6b90651c-6400-4131-a69c-0606135b5cf0', 'aa1a14ee-d206-46bd-89d3-e6a45be91bdf'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:38 devstack sudo[108324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:02:38 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:39 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.703s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2d4e1b91-dd35-4730-90d3-3d4135503416 tempest-ProjectMemberTests-855905026 None] Lock "cinder-d9e0f20a-1084-43c8-b9c9-53a7130f56ab-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (860e1a56-5149-4f80-9699-ec48866f20ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13703a36-ba50-4767-9c00-617b72e36625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13703a36-ba50-4767-9c00-617b72e36625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156088680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20663c3c-a1ff-4f10-b3ea-13ae2b1a595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:40Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab225ad7-9521-430f-963a-ee2519d04694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab225ad7-9521-430f-963a-ee2519d04694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6830df6-03ba-426d-8438-3d12c8d06032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6830df6-03ba-426d-8438-3d12c8d06032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20663c3c-a1ff-4f10-b3ea-13ae2b1a595b', 'volume_name': 'volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170c8a1b-8247-4ff8-a757-3b67b8fdb788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170c8a1b-8247-4ff8-a757-3b67b8fdb788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fe2dd6-4d0a-4c7f-b09e-e19387d83c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Volume 20663c3c-a1ff-4f10-b3ea-13ae2b1a595b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b', 'volume_size': 1}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-156088680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20663c3c-a1ff-4f10-b3ea-13ae2b1a595b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:40Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Creating volume 20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:02:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:39 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b 1073741824
Jul 07 23:02:39 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:40 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b 1073741824" returned: 0 in 0.853s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:40 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b
Jul 07 23:02:40 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:41 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" returned: 0 in 0.654s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fe2dd6-4d0a-4c7f-b09e-e19387d83c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92194c67-10d0-4742-9d24-eb8ce3e681a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Volume volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b (20663c3c-a1ff-4f10-b3ea-13ae2b1a595b): created successfully
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92194c67-10d0-4742-9d24-eb8ce3e681a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (860e1a56-5149-4f80-9699-ec48866f20ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2cd36b93-676d-441b-a6ce-56455b35761a tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 589e3bc5-e6fb-4542-9ba2-e61743a86c78 of volume 20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ea244-5c41-4c9c-a1d1-6285b415e5f1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:42 devstack sudo[108341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b
Jul 07 23:02:42 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:42 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" returned: 0 in 0.774s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:42 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 1G
Jul 07 23:02:42 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:43 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 1G" returned: 0 in 0.796s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:43 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78
Jul 07 23:02:43 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:44 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78" returned: 0 in 0.763s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:44 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 is being set with open permissions: ugo+rw
Jul 07 23:02:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:44 devstack sudo[108356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78
Jul 07 23:02:44 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:45 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78" returned: 0 in 0.703s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:45 devstack sudo[108359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info
Jul 07 23:02:45 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:45 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info is being set with open permissions: ugo+rw
Jul 07 23:02:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:45 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info
Jul 07 23:02:45 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:46 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.info" returned: 0 in 0.663s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-157bdcaa-e64f-45e8-b4cd-aced7745065e tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-589e3bc5-e6fb-4542-9ba2-e61743a86c78-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-589e3bc5-e6fb-4542-9ba2-e61743a86c78-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-589e3bc5-e6fb-4542-9ba2-e61743a86c78" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-589e3bc5-e6fb-4542-9ba2-e61743a86c78" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 589e3bc5-e6fb-4542-9ba2-e61743a86c78 of volume 20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[374b253d-35f1-4de6-9999-fc9fa07d801d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:47 devstack sudo[108366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78
Jul 07 23:02:47 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:48 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78" returned: 0 in 0.812s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:02:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fa35b1-5f23-40d9-9469-90013aee26f9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:48 devstack sudo[108371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b
Jul 07 23:02:48 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:49 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" returned: 0 in 0.793s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:49 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78
Jul 07 23:02:49 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:49 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78" returned: 0 in 0.779s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:49 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78
Jul 07 23:02:49 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:50 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b.589e3bc5-e6fb-4542-9ba2-e61743a86c78" returned: 0 in 0.689s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-589e3bc5-e6fb-4542-9ba2-e61743a86c78" released by "_delete_snapshot" :: held 3.181s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" released by "delete_snapshot" :: held 3.210s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Created reservations ['a596344b-041e-4c6d-bb5f-5e6d61928ad2', '5c078998-4292-4efe-8084-2208bee0f262', '443324c3-e81f-4fd8-ab56-c9c22edd2678', '5413e0c0-fc8b-421b-bac0-28ab4db4d401'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:02:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-2cdaa4a7-48fd-46e7-9c5c-67bce8eb29ba tempest-ProjectMemberTests-855905026 None] Lock "cinder-589e3bc5-e6fb-4542-9ba2-e61743a86c78-delete_snapshot" released by "delete_snapshot" :: held 3.376s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "cinder-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b5ac25-33e8-4098-8bdf-3c5f5b35a776]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:51 devstack sudo[108384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b
Jul 07 23:02:51 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:52 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" returned: 0 in 0.768s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:52 devstack sudo[108389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b
Jul 07 23:02:52 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:53 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" returned: 0 in 0.632s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b" released by "delete_volume" :: held 1.460s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Created reservations ['17b53863-cfc4-4be9-b209-ced21058495d', '8a501783-5740-4720-a9d3-e74ee3ebff42', 'b2894d5d-fd18-41ae-a818-ef4d12d3160a', '947c97a1-b3c2-46aa-a4f6-c6c3fec926b3'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:53 devstack sudo[108392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:02:53 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:53 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:53 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:02:53 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-6f7e5285-64ee-4de0-a2eb-8e4454f1bb9f tempest-ProjectMemberTests-855905026 None] Lock "cinder-20663c3c-a1ff-4f10-b3ea-13ae2b1a595b-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (81b5b482-7519-4781-a29f-cd5beb1404c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5c41d-65cf-40af-af60-3bfd2bff0cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbb5c41d-65cf-40af-af60-3bfd2bff0cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915505045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33081c70-53bc-44bf-bec5-f2a552b430e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:54Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d299bd-3293-4068-b794-51aeb0005bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d299bd-3293-4068-b794-51aeb0005bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b0402-1218-4ca9-83e3-6386802daa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b5b0402-1218-4ca9-83e3-6386802daa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33081c70-53bc-44bf-bec5-f2a552b430e2', 'volume_name': 'volume-33081c70-53bc-44bf-bec5-f2a552b430e2', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c4ab31-d844-4ed9-99a1-da5c3f82c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1c4ab31-d844-4ed9-99a1-da5c3f82c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fb739-671f-46e9-b6d6-8201eb92ecc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Volume 33081c70-53bc-44bf-bec5-f2a552b430e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33081c70-53bc-44bf-bec5-f2a552b430e2', 'volume_size': 1}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915505045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33081c70-53bc-44bf-bec5-f2a552b430e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:02:54Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Creating volume 33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:02:54 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:02:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:54 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 1073741824
Jul 07 23:02:54 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:55 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 1073741824" returned: 0 in 0.856s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:55 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=69,cinder:INSERT=22,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:02:55 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=68,cinder:INSERT=27,cinder:UPDATE=88,cinder:DELETE=8 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:02:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:55 devstack sudo[108401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2
Jul 07 23:02:55 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:56 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2" returned: 0 in 0.641s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (394fb739-671f-46e9-b6d6-8201eb92ecc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33081c70-53bc-44bf-bec5-f2a552b430e2', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f6a79a-fb65-440f-80ff-72cc4ba0ffeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:02:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Volume volume-33081c70-53bc-44bf-bec5-f2a552b430e2 (33081c70-53bc-44bf-bec5-f2a552b430e2): created successfully
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f6a79a-fb65-440f-80ff-72cc4ba0ffeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (81b5b482-7519-4781-a29f-cd5beb1404c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:02:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a9dc6758-e9a7-4608-bc3c-859db85fc0e5 tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 of volume 33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[927d1940-c02e-4928-a4ff-1cc83590cfdc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:02:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:56 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2
Jul 07 23:02:56 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:57 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2" returned: 0 in 0.778s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:57 devstack sudo[108410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 1G
Jul 07 23:02:57 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:58 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 1G" returned: 0 in 0.788s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33081c70-53bc-44bf-bec5-f2a552b430e2 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:58 devstack sudo[108417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33081c70-53bc-44bf-bec5-f2a552b430e2 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08
Jul 07 23:02:58 devstack sudo[108417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:58 devstack sudo[108417]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33081c70-53bc-44bf-bec5-f2a552b430e2 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" returned: 0 in 0.713s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:58 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 is being set with open permissions: ugo+rw
Jul 07 23:02:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[108422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08
Jul 07 23:02:59 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:02:59 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root
Jul 07 23:02:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" returned: 0 in 0.676s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:02:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:02:59 devstack sudo[108425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info
Jul 07 23:02:59 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:00 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info" returned: 0 in 0.677s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:00 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info is being set with open permissions: ugo+rw
Jul 07 23:03:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:00 devstack sudo[108428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info
Jul 07 23:03:00 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:01 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.info" returned: 0 in 0.682s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-6e02b6df-2833-4a07-9b8c-63c4c35cf471 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 of volume 33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c691b9-d7d5-48f6-b41b-d2d49b7ba478]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:02 devstack sudo[108431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08
Jul 07 23:03:02 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:02 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" returned: 0 in 0.830s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33081c70-53bc-44bf-bec5-f2a552b430e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[284a71b6-9a48-45a1-ba25-5cee4dd589be]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:03 devstack sudo[108438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2
Jul 07 23:03:03 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:03 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2" returned: 0 in 0.826s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:03 devstack sudo[108443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08
Jul 07 23:03:03 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:04 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:04 devstack sudo[108449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08
Jul 07 23:03:04 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:05 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2.0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" returned: 0 in 0.632s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08" released by "_delete_snapshot" :: held 3.199s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" released by "delete_snapshot" :: held 3.226s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Created reservations ['a4e7d381-917c-4758-aa67-8eb3427563bd', '062b81a8-3707-47f7-bcbb-bb4b37fe60ba', '0f867c35-1133-4904-bbb2-080ed4b0eb3f', '53982b18-04d1-415d-b272-74f29535aa75'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:03:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4697804d-c297-4ea6-8620-ff508706b5d9 tempest-ProjectMemberTests-855905026 None] Lock "cinder-0d8dc59a-f5a0-42d7-8f8a-bbe08e8c7c08-delete_snapshot" released by "delete_snapshot" :: held 3.371s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-33081c70-53bc-44bf-bec5-f2a552b430e2-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "cinder-33081c70-53bc-44bf-bec5-f2a552b430e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0284dc8-cdb0-4022-af6e-d61f8977f3f2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:06 devstack sudo[108452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2
Jul 07 23:03:06 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:07 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2" returned: 0 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:07 devstack sudo[108458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2
Jul 07 23:03:07 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:07 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-33081c70-53bc-44bf-bec5-f2a552b430e2" returned: 0 in 0.677s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-33081c70-53bc-44bf-bec5-f2a552b430e2" released by "delete_volume" :: held 1.533s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Created reservations ['370ec0e1-ea07-4df5-8aa5-61293d0ec848', '193139b9-5804-4bb6-8889-4d9964eb9ec8', '3b1a6837-1d2e-4934-8477-e237da05adb0', '6ba23429-5064-4589-80b0-27c3f51fb464'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:07 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:03:07 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:08 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.705s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7b3670da-ce60-4163-b64e-0463bb0aadd6 tempest-ProjectMemberTests-855905026 None] Lock "cinder-33081c70-53bc-44bf-bec5-f2a552b430e2-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (f3f291d3-5fcb-4990-9cff-bb0f046dd245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ba6892-dea4-49f6-a6f7-ddb460cda92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ba6892-dea4-49f6-a6f7-ddb460cda92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200318629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf6367b-ab34-429b-94b1-65a0f4c03c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:09Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2630ea8a-4ca4-4116-9894-7dc76d63d25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2630ea8a-4ca4-4116-9894-7dc76d63d25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d912bc-ad13-4c4a-baf5-a2980764e0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d912bc-ad13-4c4a-baf5-a2980764e0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf6367b-ab34-429b-94b1-65a0f4c03c9b', 'volume_name': 'volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cad7c60-cd3c-441b-a131-8b79da0ce50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cad7c60-cd3c-441b-a131-8b79da0ce50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357cdcdf-ed5f-4ee3-9770-783cac2c9346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:08 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Volume daf6367b-ab34-429b-94b1-65a0f4c03c9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b', 'volume_size': 1}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200318629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf6367b-ab34-429b-94b1-65a0f4c03c9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:09Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Creating volume daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:08 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:09 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:09 devstack sudo[108464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b 1073741824
Jul 07 23:03:09 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:09 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b 1073741824" returned: 0 in 0.811s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:09 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b
Jul 07 23:03:09 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:10 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b" returned: 0 in 0.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357cdcdf-ed5f-4ee3-9770-783cac2c9346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f7f0fd-15ab-4cba-abb1-9b3a770dcc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Volume volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b (daf6367b-ab34-429b-94b1-65a0f4c03c9b): created successfully
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f7f0fd-15ab-4cba-abb1-9b3a770dcc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (f3f291d3-5fcb-4990-9cff-bb0f046dd245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:10 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c9c1f8c6-bf9d-4149-a5eb-f47aed2e6b9a tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 6d00625d-e9b6-4d0b-9768-10f8c237d0c1 of volume daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd51c712-0b64-4cdc-9a9d-2d67437e96c2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:11 devstack sudo[108508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b
Jul 07 23:03:11 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:11 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b" returned: 0 in 0.778s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:12 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 1G
Jul 07 23:03:12 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:12 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 1G" returned: 0 in 0.811s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:12 devstack sudo[108518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1
Jul 07 23:03:12 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:13 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1" returned: 0 in 0.768s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:13 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 is being set with open permissions: ugo+rw
Jul 07 23:03:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:13 devstack sudo[108523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1
Jul 07 23:03:13 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:14 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:14 devstack sudo[108526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info
Jul 07 23:03:14 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:14 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info" returned: 0 in 0.724s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:14 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info is being set with open permissions: ugo+rw
Jul 07 23:03:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:15 devstack sudo[108529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info
Jul 07 23:03:15 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:15 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.info" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.517s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:15 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c3fa3e35-26f8-4deb-bc53-a3652b1e7bc0 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-6d00625d-e9b6-4d0b-9768-10f8c237d0c1-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-6d00625d-e9b6-4d0b-9768-10f8c237d0c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-6d00625d-e9b6-4d0b-9768-10f8c237d0c1" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d00625d-e9b6-4d0b-9768-10f8c237d0c1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 6d00625d-e9b6-4d0b-9768-10f8c237d0c1 of volume daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596890a-5940-4c36-90cc-73a0e92a6d65]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:16 devstack sudo[108534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1
Jul 07 23:03:16 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:17 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1" returned: 0 in 0.812s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:17 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:17 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c1f8b9-69d4-47c2-bbaf-2b31d370b96b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:17 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b
Jul 07 23:03:17 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:18 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b" returned: 0 in 0.755s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:18 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1
Jul 07 23:03:18 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:18 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1" returned: 0 in 0.709s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:18 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1
Jul 07 23:03:18 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:19 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b.6d00625d-e9b6-4d0b-9768-10f8c237d0c1" returned: 0 in 0.702s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d00625d-e9b6-4d0b-9768-10f8c237d0c1" released by "_delete_snapshot" :: held 3.074s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" released by "delete_snapshot" :: held 3.105s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:19 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Created reservations ['daf449cb-876c-4c37-a6b8-15e0c4768801', '94214a1f-57f3-4562-8996-2685069aaac9', '910455be-66e9-4c9a-b853-10e181e4d3fb', '506fb7fc-e9bb-4f85-87b7-5f8605ceed87'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:19 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:03:19 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-3a4a1f40-633f-42ee-80bc-599015134f70 tempest-ProjectMemberTests-855905026 None] Lock "cinder-6d00625d-e9b6-4d0b-9768-10f8c237d0c1-delete_snapshot" released by "delete_snapshot" :: held 3.263s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-daf6367b-ab34-429b-94b1-65a0f4c03c9b-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "cinder-daf6367b-ab34-429b-94b1-65a0f4c03c9b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ab3578-7276-4c13-a4f9-b0c0842c260d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:20 devstack sudo[108552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b
Jul 07 23:03:20 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:21 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b" returned: 0 in 0.773s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:21 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b
Jul 07 23:03:21 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:22 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-daf6367b-ab34-429b-94b1-65a0f4c03c9b" returned: 0 in 0.667s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-daf6367b-ab34-429b-94b1-65a0f4c03c9b" released by "delete_volume" :: held 1.503s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Created reservations ['40c26dba-4eb3-4705-a3ac-c1390b07ff1d', '943fbc19-b319-4810-b7ef-ecfa9e790d6f', '48a322e8-821b-4da0-b33d-e3b7089342a0', '6880f7d7-a88c-4621-bb26-891b5e4bfedf'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:22 devstack sudo[108560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:03:22 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:23 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.685s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:23 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ee90c2ca-7b60-41c1-b8a3-1c1bde75242d tempest-ProjectMemberTests-855905026 None] Lock "cinder-daf6367b-ab34-429b-94b1-65a0f4c03c9b-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (0ab535f0-14c1-4a40-854c-0159021c1ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45039ddb-997e-4361-9258-250cf8cd5c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45039ddb-997e-4361-9258-250cf8cd5c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23889013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec42a578-f7dd-4acb-aa0b-eb211432c117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:23Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0e6079-75f9-45b7-8fd6-e48cf0d0f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa0e6079-75f9-45b7-8fd6-e48cf0d0f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5228065a-abaf-46c5-9200-94939db469df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5228065a-abaf-46c5-9200-94939db469df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec42a578-f7dd-4acb-aa0b-eb211432c117', 'volume_name': 'volume-ec42a578-f7dd-4acb-aa0b-eb211432c117', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795b792-ec89-4c31-9ecf-280ca10a184e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795b792-ec89-4c31-9ecf-280ca10a184e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888a06b5-ce81-428b-a083-5ea4211c282a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:23 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Volume ec42a578-f7dd-4acb-aa0b-eb211432c117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec42a578-f7dd-4acb-aa0b-eb211432c117', 'volume_size': 1}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-23889013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec42a578-f7dd-4acb-aa0b-eb211432c117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:23Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Creating volume ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:23 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:03:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:23 devstack sudo[108563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 1073741824
Jul 07 23:03:23 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:24 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 1073741824" returned: 0 in 0.829s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:24 devstack sudo[108569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117
Jul 07 23:03:24 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:25 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117" returned: 0 in 0.700s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888a06b5-ce81-428b-a083-5ea4211c282a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec42a578-f7dd-4acb-aa0b-eb211432c117', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d24794-84d3-4c35-aace-e7267ca1a316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Volume volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 (ec42a578-f7dd-4acb-aa0b-eb211432c117): created successfully
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d24794-84d3-4c35-aace-e7267ca1a316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (0ab535f0-14c1-4a40-854c-0159021c1ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-608ed284-21ca-4cf3-a2d5-d8521fe4383c tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 44f4d22a-068e-4bba-bd01-f9ed49eb3277 of volume ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[208018b8-07b4-4caa-89f4-f2dbcdd89389]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:25 devstack sudo[108572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117
Jul 07 23:03:25 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:26 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117" returned: 0 in 0.762s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:26 devstack sudo[108578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 1G
Jul 07 23:03:26 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:27 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 1G" returned: 0 in 0.822s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:27 devstack sudo[108584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277
Jul 07 23:03:27 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:27 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277" returned: 0 in 0.711s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:27 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 is being set with open permissions: ugo+rw
Jul 07 23:03:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:28 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277
Jul 07 23:03:28 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:28 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:28 devstack sudo[108592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info
Jul 07 23:03:28 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:29 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info" returned: 0 in 0.720s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:29 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info is being set with open permissions: ugo+rw
Jul 07 23:03:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:29 devstack sudo[108595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info
Jul 07 23:03:29 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:30 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.info" returned: 0 in 0.655s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.425s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:30 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-5f91fb8e-6bc0-4438-aee0-317264b92745 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-44f4d22a-068e-4bba-bd01-f9ed49eb3277-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-44f4d22a-068e-4bba-bd01-f9ed49eb3277-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-44f4d22a-068e-4bba-bd01-f9ed49eb3277" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-44f4d22a-068e-4bba-bd01-f9ed49eb3277" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 44f4d22a-068e-4bba-bd01-f9ed49eb3277 of volume ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13f896-bf14-44af-ab0e-c7ab8e296002]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:31 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277
Jul 07 23:03:31 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:31 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277" returned: 0 in 0.796s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:31 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec42a578-f7dd-4acb-aa0b-eb211432c117(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:31 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9cfdf1-d689-474a-bdeb-4c370c341c84]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:31 devstack sudo[108603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117
Jul 07 23:03:31 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:32 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117" returned: 0 in 0.928s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:32 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277
Jul 07 23:03:32 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:33 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277" returned: 0 in 0.812s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:33 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277
Jul 07 23:03:33 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:33 devstack sudo[108615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:03:33 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:34 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117.44f4d22a-068e-4bba-bd01-f9ed49eb3277" returned: 0 in 0.668s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-44f4d22a-068e-4bba-bd01-f9ed49eb3277" released by "_delete_snapshot" :: held 3.310s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" released by "delete_snapshot" :: held 3.332s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Created reservations ['a35f88ed-169d-4997-9df4-0173907caabc', 'f840cabe-9daa-4c47-8ee2-76c067438b72', '36b39923-3efd-4ee5-8357-54d0a68f30ca', '107d5a16-791b-4faa-8193-c5e76b1bb83d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:34 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89ceb1ec-287d-4a92-8a1f-bd14dec2c663 tempest-ProjectMemberTests-855905026 None] Lock "cinder-44f4d22a-068e-4bba-bd01-f9ed49eb3277-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:34 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.668s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:03:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-ec42a578-f7dd-4acb-aa0b-eb211432c117-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "cinder-ec42a578-f7dd-4acb-aa0b-eb211432c117-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f26c35a-a563-4a8b-ae1b-eec0ae0be0f0]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:35 devstack sudo[108619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117
Jul 07 23:03:35 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:36 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117" returned: 0 in 0.788s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:36 devstack sudo[108624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117
Jul 07 23:03:36 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:36 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-ec42a578-f7dd-4acb-aa0b-eb211432c117" returned: 0 in 0.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-ec42a578-f7dd-4acb-aa0b-eb211432c117" released by "delete_volume" :: held 1.509s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Created reservations ['f4d84688-f799-499b-9be9-f6ed04c01648', '7facfd81-1974-46e9-9127-88bc6aff9e85', '3c0569c8-05d3-4ad5-a652-c8a71c4884a2', 'a068a2fc-8c5d-4830-8318-4c5d1f0582d4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:36 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:36 devstack sudo[108628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:03:36 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:37 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:37 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-02f4f7c5-a27a-4ae6-b266-f08bc593d6bf tempest-ProjectMemberTests-855905026 None] Lock "cinder-ec42a578-f7dd-4acb-aa0b-eb211432c117-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (69142573-1142-4661-90ee-78c2c40940b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fce703d-ceca-427d-bf1b-96added9b478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fce703d-ceca-427d-bf1b-96added9b478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115590255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d99821d-685b-49ae-9c34-e50faf128ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:38Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ac058-f370-48b7-9faa-90a3bc35ea9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79ac058-f370-48b7-9faa-90a3bc35ea9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07d7430-1925-4ab5-bf53-65bf856eecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b07d7430-1925-4ab5-bf53-65bf856eecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d99821d-685b-49ae-9c34-e50faf128ed8', 'volume_name': 'volume-6d99821d-685b-49ae-9c34-e50faf128ed8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba53690c-b907-4e1d-bcbb-e87d72a76e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba53690c-b907-4e1d-bcbb-e87d72a76e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e011fd-8dab-42f6-9a40-1ebef4cfac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:37 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Volume 6d99821d-685b-49ae-9c34-e50faf128ed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d99821d-685b-49ae-9c34-e50faf128ed8', 'volume_size': 1}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1115590255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d99821d-685b-49ae-9c34-e50faf128ed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d40e3b02df4e450699e082da95de6a7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:38Z,use_quota=True,user_id='ecf0743c34134c81b196199ac47fddb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Creating volume 6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:37 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:03:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:38 devstack sudo[108631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 1073741824
Jul 07 23:03:38 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:38 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 1073741824" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:38 devstack sudo[108637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8
Jul 07 23:03:38 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:39 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8" returned: 0 in 0.632s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.464s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85e011fd-8dab-42f6-9a40-1ebef4cfac5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d99821d-685b-49ae-9c34-e50faf128ed8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c606f97-3f73-463c-88cb-463cc06b4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Volume volume-6d99821d-685b-49ae-9c34-e50faf128ed8 (6d99821d-685b-49ae-9c34-e50faf128ed8): created successfully
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c606f97-3f73-463c-88cb-463cc06b4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Flow 'volume_create_manager' (69142573-1142-4661-90ee-78c2c40940b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-1fbc432a-7988-4d32-ab71-195a7c9c8977 tempest-ProjectMemberTests-855905026 None] Created volume successfully.
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Creating offline snapshot 559dc055-137a-4e13-8824-cdcb8cfb3ab1 of volume 6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[189daf12-03da-4e8d-ae20-67d2405d5a43]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:40 devstack sudo[108646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8
Jul 07 23:03:40 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:40 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8" returned: 0 in 0.760s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:40 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 1G
Jul 07 23:03:40 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:41 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 1G" returned: 0 in 0.810s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99821d-685b-49ae-9c34-e50faf128ed8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:41 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99821d-685b-49ae-9c34-e50faf128ed8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1
Jul 07 23:03:41 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:42 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d99821d-685b-49ae-9c34-e50faf128ed8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1" returned: 0 in 0.689s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:42 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 is being set with open permissions: ugo+rw
Jul 07 23:03:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:42 devstack sudo[108662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1
Jul 07 23:03:42 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:43 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1" returned: 0 in 0.650s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:43 devstack sudo[108665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info
Jul 07 23:03:43 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:43 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info" returned: 0 in 0.639s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:43 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info is being set with open permissions: ugo+rw
Jul 07 23:03:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:43 devstack sudo[108668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info
Jul 07 23:03:43 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:44 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.info" returned: 0 in 0.644s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.267s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:44 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-18844a3c-3bde-4bbd-95bd-9c5e15952e18 tempest-ProjectMemberTests-855905026 None] Create snapshot completed successfully
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-559dc055-137a-4e13-8824-cdcb8cfb3ab1-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-559dc055-137a-4e13-8824-cdcb8cfb3ab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-559dc055-137a-4e13-8824-cdcb8cfb3ab1" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-559dc055-137a-4e13-8824-cdcb8cfb3ab1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Deleting offline snapshot 559dc055-137a-4e13-8824-cdcb8cfb3ab1 of volume 6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] snapshot_file for this snap is: volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aad864-c471-4c2e-ba39-a02195a94b2b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:45 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1
Jul 07 23:03:45 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:46 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:46 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d99821d-685b-49ae-9c34-e50faf128ed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:03:46 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e999b170-c11f-4787-9f62-d462ebc173d8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:46 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8
Jul 07 23:03:46 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:47 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8" returned: 0 in 0.793s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:47 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1
Jul 07 23:03:47 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:47 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:47 devstack sudo[108687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1
Jul 07 23:03:47 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:48 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8.559dc055-137a-4e13-8824-cdcb8cfb3ab1" returned: 0 in 0.714s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-559dc055-137a-4e13-8824-cdcb8cfb3ab1" released by "_delete_snapshot" :: held 3.146s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" released by "delete_snapshot" :: held 3.172s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:48 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Created reservations ['bec31e11-cc2e-4be3-a7fe-65451a8432dc', 'ab385c91-1add-472d-81eb-0f660fbd8fad', 'a0517959-6bca-407b-be4e-7c7edf30a239', '2aec18af-536d-4664-b8a8-eb55731fdaa1'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:48 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Delete snapshot completed successfully.
Jul 07 23:03:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-50b7fb5b-0f43-40ce-a7fd-603a1cc46589 tempest-ProjectMemberTests-855905026 None] Lock "cinder-559dc055-137a-4e13-8824-cdcb8cfb3ab1-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-6d99821d-685b-49ae-9c34-e50faf128ed8-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "cinder-6d99821d-685b-49ae-9c34-e50faf128ed8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Acquiring lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" acquired by "delete_volume" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf80168-4723-44b3-95ff-4ca7f6cc6815]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:49 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8
Jul 07 23:03:49 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:50 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8" returned: 0 in 0.814s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:50 devstack sudo[108695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8
Jul 07 23:03:50 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:51 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-6d99821d-685b-49ae-9c34-e50faf128ed8" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "cinder-quobyte-6d99821d-685b-49ae-9c34-e50faf128ed8" released by "delete_volume" :: held 1.550s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Created reservations ['d2fc5a11-3ff7-49ad-bbd4-8fd77b2c984f', '27fb021f-2810-4dc8-b732-aed35bfc01bb', '4eb18958-845c-43ec-993b-f9d91a310543', '0cb06ab8-3715-4707-81e5-94cf62384724'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:51 devstack sudo[108698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:03:51 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:52 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.759s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:52 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:03:52 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Deleted volume successfully.
Jul 07 23:03:52 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0cf257bd-751b-4827-a741-3d9f558a0c89 tempest-ProjectMemberTests-855905026 None] Lock "cinder-6d99821d-685b-49ae-9c34-e50faf128ed8-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=70,cinder:DELETE=6,cinder:SELECT=55,cinder:INSERT=26 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=55,cinder:INSERT=14,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (5d4cea17-78dd-4ba2-b440-35934dd550ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8c9389-b5f6-4234-a403-1c35ed452f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8c9389-b5f6-4234-a403-1c35ed452f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974120534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb77392-ef33-4f4f-a5e2-ae2c839b3043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:56Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ac2382-61d6-4ecc-b24c-56dd8b83050e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ac2382-61d6-4ecc-b24c-56dd8b83050e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d893c407-aa5f-4c1b-9007-53ae35a17a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d893c407-aa5f-4c1b-9007-53ae35a17a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb77392-ef33-4f4f-a5e2-ae2c839b3043', 'volume_name': 'volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c7eba-f177-491c-a13e-6949f07d4439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e0c7eba-f177-491c-a13e-6949f07d4439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf8c46b-72ae-4065-b386-438ffe1b3f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Volume aeb77392-ef33-4f4f-a5e2-ae2c839b3043: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043', 'volume_size': 1}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-974120534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb77392-ef33-4f4f-a5e2-ae2c839b3043,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:03:56Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Creating volume aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:03:56 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:03:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:56 devstack sudo[108703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 1073741824
Jul 07 23:03:56 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:57 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 1073741824" returned: 0 in 0.941s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:57 devstack sudo[108709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043
Jul 07 23:03:57 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:57 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" returned: 0 in 0.662s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf8c46b-72ae-4065-b386-438ffe1b3f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e360b328-67fb-4454-98dd-ec72363e8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:03:57 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Volume volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 (aeb77392-ef33-4f4f-a5e2-ae2c839b3043): created successfully
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e360b328-67fb-4454-98dd-ec72363e8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:03:57 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (5d4cea17-78dd-4ba2-b440-35934dd550ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:03:57 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-3708a31e-d66d-4e04-9ccf-691d2f717e54 tempest-ProjectReaderTests-374711994 None] Created volume successfully.
Jul 07 23:03:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:03:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:03:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Creating offline snapshot 20c60072-dbfc-42e7-b88a-c13a4e0ed298 of volume aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:03:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[59148bae-474b-40a1-b216-b75dd3d1533e]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:03:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:58 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043
Jul 07 23:03:58 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:03:59 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Jul 07 23:03:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" returned: 0 in 0.869s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:03:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:03:59 devstack sudo[108719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 1G
Jul 07 23:03:59 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:00 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 1G" returned: 0 in 0.890s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:00 devstack sudo[108724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298
Jul 07 23:04:00 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:00 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298" returned: 0 in 0.688s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:00 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 is being set with open permissions: ugo+rw
Jul 07 23:04:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:00 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298
Jul 07 23:04:00 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:01 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298" returned: 0 in 0.701s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:01 devstack sudo[108732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info
Jul 07 23:04:01 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:02 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info" returned: 0 in 0.693s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:02 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info is being set with open permissions: ugo+rw
Jul 07 23:04:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:02 devstack sudo[108735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info
Jul 07 23:04:02 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:03 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.info" returned: 0 in 0.701s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.635s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:03 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-95afd6dc-bd97-414c-b398-166ee8e02d4c tempest-ProjectReaderTests-374711994 None] Create snapshot completed successfully
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-20c60072-dbfc-42e7-b88a-c13a4e0ed298-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-20c60072-dbfc-42e7-b88a-c13a4e0ed298-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-20c60072-dbfc-42e7-b88a-c13a4e0ed298" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-20c60072-dbfc-42e7-b88a-c13a4e0ed298" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Deleting offline snapshot 20c60072-dbfc-42e7-b88a-c13a4e0ed298 of volume aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] snapshot_file for this snap is: volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc82e8d-e1cb-4932-96ce-e311ca939b34]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:04 devstack sudo[108738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298
Jul 07 23:04:04 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:04 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298" returned: 0 in 0.837s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:04 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c4c36e-141e-41c8-a588-3031f6f0e5d8]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:04 devstack sudo[108743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043
Jul 07 23:04:04 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:05 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" returned: 0 in 0.884s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:05 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298
Jul 07 23:04:05 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:06 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298" returned: 0 in 0.769s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:06 devstack sudo[108755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298
Jul 07 23:04:06 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:07 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043.20c60072-dbfc-42e7-b88a-c13a4e0ed298" returned: 0 in 0.714s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-20c60072-dbfc-42e7-b88a-c13a4e0ed298" released by "_delete_snapshot" :: held 3.301s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" released by "delete_snapshot" :: held 3.324s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Created reservations ['f94fdd2e-8150-46cb-b488-493dc5cdb574', '176bcb65-bbda-4a6d-ac4d-55e354c1bc84', 'db62d829-70be-4ff1-80f9-c61b148e629b', 'a3ddb012-f2fb-4f27-8203-6c15a52adabe'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:07 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Delete snapshot completed successfully.
Jul 07 23:04:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7abcee3d-ef86-4c0f-bef6-8331a9794d4f tempest-ProjectReaderTests-374711994 None] Lock "cinder-20c60072-dbfc-42e7-b88a-c13a4e0ed298-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-aeb77392-ef33-4f4f-a5e2-ae2c839b3043-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "cinder-aeb77392-ef33-4f4f-a5e2-ae2c839b3043-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2687d4-7566-4dac-affb-55bf25feac85]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:08 devstack sudo[108758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043
Jul 07 23:04:08 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:08 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:09 devstack sudo[108763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043
Jul 07 23:04:09 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:09 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" returned: 0 in 0.673s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-aeb77392-ef33-4f4f-a5e2-ae2c839b3043" released by "delete_volume" :: held 1.522s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Created reservations ['98bdc880-5b71-4c38-9061-50702b162445', '1dd1ced7-aea8-4fae-b7af-bf08f799c9c6', 'f166d9ce-449f-43a8-9302-efbe1eba19f3', 'deed31d7-cadb-483a-aaeb-16773265064c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:09 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:09 devstack sudo[108766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:04:09 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:10 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.704s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:10 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Deleted volume successfully.
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-46554822-87f6-48bc-ac6c-cf82d85aa269 tempest-ProjectReaderTests-374711994 None] Lock "cinder-aeb77392-ef33-4f4f-a5e2-ae2c839b3043-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (be01673e-3c21-44cd-842a-cbe4d00b2a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29279780-2835-4e1a-9d5f-9dd606d679c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29279780-2835-4e1a-9d5f-9dd606d679c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084513687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2d2cb8-0029-4b1e-97c8-8356750586cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:11Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68962953-7d02-4dd9-8f8c-bf8fd96e3145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68962953-7d02-4dd9-8f8c-bf8fd96e3145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f684b-36d2-45c4-a12a-6c743ef6cfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (363f684b-36d2-45c4-a12a-6c743ef6cfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2d2cb8-0029-4b1e-97c8-8356750586cd', 'volume_name': 'volume-be2d2cb8-0029-4b1e-97c8-8356750586cd', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59baffb9-0d09-464d-abe0-c0b31e8514f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59baffb9-0d09-464d-abe0-c0b31e8514f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d21fd4-614e-4f2d-8ad3-968dfffc4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:10 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Volume be2d2cb8-0029-4b1e-97c8-8356750586cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2d2cb8-0029-4b1e-97c8-8356750586cd', 'volume_size': 1}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084513687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2d2cb8-0029-4b1e-97c8-8356750586cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:11Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Creating volume be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:10 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:04:10 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:10 devstack sudo[108805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd 1073741824
Jul 07 23:04:10 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:11 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd 1073741824" returned: 0 in 0.871s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:11 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:11 devstack sudo[108810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd
Jul 07 23:04:11 devstack sudo[108810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:12 devstack sudo[108810]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd" returned: 0 in 0.685s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1d21fd4-614e-4f2d-8ad3-968dfffc4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2d2cb8-0029-4b1e-97c8-8356750586cd', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c169e-9e0d-4887-91a3-f9f9c7cfc340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:12 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Volume volume-be2d2cb8-0029-4b1e-97c8-8356750586cd (be2d2cb8-0029-4b1e-97c8-8356750586cd): created successfully
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03c169e-9e0d-4887-91a3-f9f9c7cfc340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:12 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (be01673e-3c21-44cd-842a-cbe4d00b2a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:12 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a7ccd080-0d81-4d74-bea8-85519fe7c407 tempest-ProjectReaderTests-374711994 None] Created volume successfully.
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Creating offline snapshot a7852975-fde3-4411-ad0e-b8c2d91b2cc8 of volume be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd282190-9dc4-4e71-8ca4-1533145ab02b]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:13 devstack sudo[108813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd
Jul 07 23:04:13 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:13 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd" returned: 0 in 0.778s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:13 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:13 devstack sudo[108818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 1G
Jul 07 23:04:13 devstack sudo[108818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:14 devstack sudo[108818]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 1G" returned: 0 in 0.846s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:14 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d2cb8-0029-4b1e-97c8-8356750586cd -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:14 devstack sudo[108823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d2cb8-0029-4b1e-97c8-8356750586cd -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8
Jul 07 23:04:14 devstack sudo[108823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:15 devstack sudo[108823]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be2d2cb8-0029-4b1e-97c8-8356750586cd -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:15 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 is being set with open permissions: ugo+rw
Jul 07 23:04:15 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:15 devstack sudo[108828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8
Jul 07 23:04:15 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:16 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8" returned: 0 in 0.647s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:16 devstack sudo[108831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info
Jul 07 23:04:16 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:16 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info" returned: 0 in 0.653s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:16 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info is being set with open permissions: ugo+rw
Jul 07 23:04:16 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:16 devstack sudo[108836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info
Jul 07 23:04:16 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:17 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.info" returned: 0 in 0.710s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:17 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.392s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:17 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d9834115-6e44-4dfe-98ae-d0f32b0109a5 tempest-ProjectReaderTests-374711994 None] Create snapshot completed successfully
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-a7852975-fde3-4411-ad0e-b8c2d91b2cc8-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-a7852975-fde3-4411-ad0e-b8c2d91b2cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-a7852975-fde3-4411-ad0e-b8c2d91b2cc8" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-a7852975-fde3-4411-ad0e-b8c2d91b2cc8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Deleting offline snapshot a7852975-fde3-4411-ad0e-b8c2d91b2cc8 of volume be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] snapshot_file for this snap is: volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d23767-e5b4-4612-9dd3-b76aefa57bb9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:18 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:18 devstack sudo[108839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8
Jul 07 23:04:18 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:19 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8" returned: 0 in 0.770s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be2d2cb8-0029-4b1e-97c8-8356750586cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb32f13-3a3f-4fad-a70d-0e8a8420402d]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:19 devstack sudo[108844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd
Jul 07 23:04:19 devstack sudo[108844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:19 devstack sudo[108844]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd" returned: 0 in 0.785s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:19 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:20 devstack sudo[108849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8
Jul 07 23:04:20 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:20 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8" returned: 0 in 0.755s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:20 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:20 devstack sudo[108854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8
Jul 07 23:04:20 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:21 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:21 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd.a7852975-fde3-4411-ad0e-b8c2d91b2cc8" returned: 0 in 0.689s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-a7852975-fde3-4411-ad0e-b8c2d91b2cc8" released by "_delete_snapshot" :: held 3.098s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" released by "delete_snapshot" :: held 3.123s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:21 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Created reservations ['2e632802-6a45-4b50-8986-cb7882d9e44e', '59078b38-abf6-4710-b648-a8701d831552', 'ee61932d-f15e-408c-a849-3175c1766c15', '950e443c-be11-4bec-9971-ded597559a4d'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:21 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Delete snapshot completed successfully.
Jul 07 23:04:21 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-7ba252b0-6201-497b-88ef-26a7a4cfa557 tempest-ProjectReaderTests-374711994 None] Lock "cinder-a7852975-fde3-4411-ad0e-b8c2d91b2cc8-delete_snapshot" released by "delete_snapshot" :: held 3.285s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-be2d2cb8-0029-4b1e-97c8-8356750586cd-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "cinder-be2d2cb8-0029-4b1e-97c8-8356750586cd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" acquired by "delete_volume" :: waited 0.012s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4282b5-34a9-4480-8e34-026a4e265e79]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:22 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:22 devstack sudo[108857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd
Jul 07 23:04:22 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:23 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd" returned: 0 in 0.773s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:23 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:23 devstack sudo[108862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd
Jul 07 23:04:23 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:24 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-be2d2cb8-0029-4b1e-97c8-8356750586cd" returned: 0 in 0.653s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-be2d2cb8-0029-4b1e-97c8-8356750586cd" released by "delete_volume" :: held 1.489s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Created reservations ['6808ffd0-c33d-4b5d-bb0e-dc5347f9166f', '5653df80-adc0-47d1-923b-573cde7345aa', '36849099-c0e0-4f35-94aa-62f5d0d047b3', '2330d4f1-cd47-446c-bf4c-322be3ab8cea'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:24 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:24 devstack sudo[108865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:04:24 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:25 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.718s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:25 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Deleted volume successfully.
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-e902ecec-b952-423e-8ab2-27e1721a1c4d tempest-ProjectReaderTests-374711994 None] Lock "cinder-be2d2cb8-0029-4b1e-97c8-8356750586cd-delete_volume" released by "delete_volume" :: held 2.477s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (1a40a1db-a33f-4bb7-bc26-1c15dc6fa460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de73e7a-127c-4a80-aae8-514519ae72bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de73e7a-127c-4a80-aae8-514519ae72bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118447502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfec0bd-dda9-418d-ac8d-e60e16228505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:25Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec66c-70c5-4ae8-a5bd-50d6cb63c839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6cec66c-70c5-4ae8-a5bd-50d6cb63c839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ce14c-3d10-4f3d-ab4d-5a6d1ab02a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ce14c-3d10-4f3d-ab4d-5a6d1ab02a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfec0bd-dda9-418d-ac8d-e60e16228505', 'volume_name': 'volume-3bfec0bd-dda9-418d-ac8d-e60e16228505', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d119c19e-d227-4a22-86f7-876919d59a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d119c19e-d227-4a22-86f7-876919d59a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d78b92-21b7-4235-9e71-5bf9b2722b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:25 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Volume 3bfec0bd-dda9-418d-ac8d-e60e16228505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfec0bd-dda9-418d-ac8d-e60e16228505', 'volume_size': 1}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2118447502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfec0bd-dda9-418d-ac8d-e60e16228505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:25Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Creating volume 3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:25 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:04:25 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:25 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 1073741824
Jul 07 23:04:25 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:26 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 1073741824" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:26 devstack sudo[108873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505
Jul 07 23:04:26 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:26 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505" returned: 0 in 0.644s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d78b92-21b7-4235-9e71-5bf9b2722b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfec0bd-dda9-418d-ac8d-e60e16228505', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e28c0c-3876-4bf6-b912-37ec7a8ec9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:26 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Volume volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 (3bfec0bd-dda9-418d-ac8d-e60e16228505): created successfully
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e28c0c-3876-4bf6-b912-37ec7a8ec9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:26 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (1a40a1db-a33f-4bb7-bc26-1c15dc6fa460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:26 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a291df1b-7e3b-4453-b604-00cd53d03962 tempest-ProjectReaderTests-374711994 None] Created volume successfully.
Jul 07 23:04:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:27 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Creating offline snapshot 9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 of volume 3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:27 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdc3db3-a011-4125-8dda-9cca36a757dd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:27 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:27 devstack sudo[108877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505
Jul 07 23:04:27 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:28 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505" returned: 0 in 0.778s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:28 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:28 devstack sudo[108882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 1G
Jul 07 23:04:28 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:29 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 1G" returned: 0 in 0.839s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:29 devstack sudo[108887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5
Jul 07 23:04:29 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:29 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" returned: 0 in 0.741s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:29 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 is being set with open permissions: ugo+rw
Jul 07 23:04:29 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:29 devstack sudo[108892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5
Jul 07 23:04:29 devstack sudo[108892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:30 devstack sudo[108892]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" returned: 0 in 0.715s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:30 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:30 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info
Jul 07 23:04:30 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:31 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info" returned: 0 in 0.704s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:31 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info is being set with open permissions: ugo+rw
Jul 07 23:04:31 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:31 devstack sudo[108898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info
Jul 07 23:04:31 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:32 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.info" returned: 0 in 0.717s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:32 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f57f3e83-953e-451b-a1b9-0f41cbcef3b5 tempest-ProjectReaderTests-374711994 None] Create snapshot completed successfully
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Deleting offline snapshot 9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 of volume 3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] snapshot_file for this snap is: volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fa72c5-eb3c-446a-9540-ebb8061903ae]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:32 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:32 devstack sudo[108901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5
Jul 07 23:04:32 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:33 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" returned: 0 in 0.780s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bfec0bd-dda9-418d-ac8d-e60e16228505(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfe3277-9ea7-40f4-a72f-c22b4e652843]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:33 devstack sudo[108906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505
Jul 07 23:04:33 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:33 devstack sudo[108908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:04:33 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:34 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505" returned: 0 in 0.794s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:34 devstack sudo[108914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5
Jul 07 23:04:34 devstack sudo[108914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:34 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.675s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:04:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:04:35 devstack sudo[108914]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" returned: 0 in 0.773s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:35 devstack sudo[108919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5
Jul 07 23:04:35 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:35 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:35 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505.9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" returned: 0 in 0.698s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5" released by "_delete_snapshot" :: held 3.141s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:35 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" released by "delete_snapshot" :: held 3.166s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:36 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Created reservations ['dcd292c8-c33a-42ed-863d-c876e315f4b1', 'ea6428e8-37c6-4324-b390-cfaa7aacb58f', '4d96cb87-dc59-488d-855d-5f6de6738176', 'bf22d9f2-8f8e-4529-8c79-b8e68d4fe8f4'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:36 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Delete snapshot completed successfully.
Jul 07 23:04:36 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-89924953-4c87-4d39-8bc7-b57bc0f4dcee tempest-ProjectReaderTests-374711994 None] Lock "cinder-9e8396d0-ae50-4c40-b94e-a37eb3a9afe5-delete_snapshot" released by "delete_snapshot" :: held 3.309s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-3bfec0bd-dda9-418d-ac8d-e60e16228505-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "cinder-3bfec0bd-dda9-418d-ac8d-e60e16228505-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[225fe4e9-505c-4a6d-9543-1440ba7f26fc]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:37 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:37 devstack sudo[108923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505
Jul 07 23:04:37 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:37 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505" returned: 0 in 0.844s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:38 devstack sudo[108928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505
Jul 07 23:04:38 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:38 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-3bfec0bd-dda9-418d-ac8d-e60e16228505" returned: 0 in 0.746s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-3bfec0bd-dda9-418d-ac8d-e60e16228505" released by "delete_volume" :: held 1.659s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Created reservations ['38314848-97db-41d6-b85b-dacee9b05f0e', 'b8658927-0d7e-42a2-9b15-73a9271276de', 'cdba48c9-ca0d-4ffa-8169-5eb661f0f784', '828c08ca-dfcb-441b-ac8a-70fbbeda5575'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:38 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:38 devstack sudo[108931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:04:38 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:39 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.725s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:39 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Deleted volume successfully.
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-a3ad95a1-e191-42cb-b736-c9b97108d1b9 tempest-ProjectReaderTests-374711994 None] Lock "cinder-3bfec0bd-dda9-418d-ac8d-e60e16228505-delete_volume" released by "delete_volume" :: held 2.628s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (b22db57a-1491-421a-be4d-2da1ab94fe39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e91b5-cc94-4a7e-a924-6d2a6cc2a339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033e91b5-cc94-4a7e-a924-6d2a6cc2a339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138175364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb73112-e6c8-4a54-816d-a31678bf4514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:40Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f656a0a7-27db-4ea2-8f0b-0d3d47bc590d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f656a0a7-27db-4ea2-8f0b-0d3d47bc590d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09d4391-b27b-4d23-abb2-31c3e86868df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d09d4391-b27b-4d23-abb2-31c3e86868df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb73112-e6c8-4a54-816d-a31678bf4514', 'volume_name': 'volume-2eb73112-e6c8-4a54-816d-a31678bf4514', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a93f316-035d-43df-b7a6-cdedc9b0d60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a93f316-035d-43df-b7a6-cdedc9b0d60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dd2922-2742-45ea-b720-78fd93516268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:39 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Volume 2eb73112-e6c8-4a54-816d-a31678bf4514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb73112-e6c8-4a54-816d-a31678bf4514', 'volume_size': 1}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138175364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb73112-e6c8-4a54-816d-a31678bf4514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:40Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Creating volume 2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:39 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:04:39 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:40 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 1073741824
Jul 07 23:04:40 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:40 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 1073741824" returned: 0 in 0.887s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:40 devstack sudo[108946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514
Jul 07 23:04:40 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:41 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514" returned: 0 in 0.677s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60dd2922-2742-45ea-b720-78fd93516268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb73112-e6c8-4a54-816d-a31678bf4514', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e51312-fca7-458a-a008-7df089c9d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:41 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Volume volume-2eb73112-e6c8-4a54-816d-a31678bf4514 (2eb73112-e6c8-4a54-816d-a31678bf4514): created successfully
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83e51312-fca7-458a-a008-7df089c9d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:41 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (b22db57a-1491-421a-be4d-2da1ab94fe39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:41 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c050a0c1-d980-4122-99fe-c529abd3ffaa tempest-ProjectReaderTests-374711994 None] Created volume successfully.
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Creating offline snapshot 4ab9de03-8db1-41bf-8527-357593e2038b of volume 2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a3dfb-ee58-43af-96fa-0851dabd8868]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:42 devstack sudo[108949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514
Jul 07 23:04:42 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:42 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514" returned: 0 in 0.784s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:42 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b 1G
Jul 07 23:04:42 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:43 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b 1G" returned: 0 in 0.811s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eb73112-e6c8-4a54-816d-a31678bf4514 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:43 devstack sudo[108959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eb73112-e6c8-4a54-816d-a31678bf4514 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b
Jul 07 23:04:43 devstack sudo[108959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:44 devstack sudo[108959]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2eb73112-e6c8-4a54-816d-a31678bf4514 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b" returned: 0 in 0.714s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:44 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b is being set with open permissions: ugo+rw
Jul 07 23:04:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:44 devstack sudo[108964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b
Jul 07 23:04:44 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:45 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b" returned: 0 in 0.684s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:45 devstack sudo[108967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info
Jul 07 23:04:45 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:45 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info is being set with open permissions: ugo+rw
Jul 07 23:04:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:45 devstack sudo[108970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info
Jul 07 23:04:45 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:46 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.info" returned: 0 in 0.683s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.438s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:46 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c80dba64-1084-462d-abd0-6ff55371b470 tempest-ProjectReaderTests-374711994 None] Create snapshot completed successfully
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-4ab9de03-8db1-41bf-8527-357593e2038b-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-4ab9de03-8db1-41bf-8527-357593e2038b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-4ab9de03-8db1-41bf-8527-357593e2038b" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-4ab9de03-8db1-41bf-8527-357593e2038b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Deleting offline snapshot 4ab9de03-8db1-41bf-8527-357593e2038b of volume 2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] snapshot_file for this snap is: volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[23882f6f-4580-4dee-b8a0-14014835cbd5]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:47 devstack sudo[108974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b
Jul 07 23:04:47 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:48 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b" returned: 0 in 0.789s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2eb73112-e6c8-4a54-816d-a31678bf4514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:04:48 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a86f0-9721-419f-b4e4-05ad5b6a9d04]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:48 devstack sudo[108979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514
Jul 07 23:04:48 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:49 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514" returned: 0 in 0.858s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:49 devstack sudo[108984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b
Jul 07 23:04:49 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:49 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b" returned: 0 in 0.792s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:49 devstack sudo[108989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b
Jul 07 23:04:49 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:50 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514.4ab9de03-8db1-41bf-8527-357593e2038b" returned: 0 in 0.670s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-4ab9de03-8db1-41bf-8527-357593e2038b" released by "_delete_snapshot" :: held 3.215s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" released by "delete_snapshot" :: held 3.237s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:50 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Created reservations ['a4c9e9dd-029c-447d-86e7-a06e9272d387', '85f1e9e7-c048-4d01-8202-7ded7b77f963', '5c2cd7fd-fd33-4e11-87e9-d29a081fdb6e', '00bb25a8-acb2-48e8-80e4-d6b1e2c0c90c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:50 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Delete snapshot completed successfully.
Jul 07 23:04:50 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-c3bbd8f3-6a6f-455b-b20a-7d44debf2b18 tempest-ProjectReaderTests-374711994 None] Lock "cinder-4ab9de03-8db1-41bf-8527-357593e2038b-delete_snapshot" released by "delete_snapshot" :: held 3.399s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-2eb73112-e6c8-4a54-816d-a31678bf4514-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "cinder-2eb73112-e6c8-4a54-816d-a31678bf4514-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd04b2df-fe76-4530-9718-9f1ca7fb08f1]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:51 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:51 devstack sudo[108992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514
Jul 07 23:04:51 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:52 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514" returned: 0 in 0.808s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:52 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:52 devstack sudo[108997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514
Jul 07 23:04:52 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:53 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-2eb73112-e6c8-4a54-816d-a31678bf4514" returned: 0 in 0.672s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-2eb73112-e6c8-4a54-816d-a31678bf4514" released by "delete_volume" :: held 1.544s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Created reservations ['553418cf-eb0b-43b5-a2f5-c77d8b775c7c', '161acbe3-9d71-4052-85ac-8e2d9023f4e1', '39e7c412-1b27-4b9c-8ed3-7c493a2f61eb', 'a3e8e0be-c89a-4396-b6c8-ba183410fb5c'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:53 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:53 devstack sudo[109000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:04:53 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:54 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.675s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:04:54 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Deleted volume successfully.
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-88303dcb-da92-430e-9485-4f38cf42fe0e tempest-ProjectReaderTests-374711994 None] Lock "cinder-2eb73112-e6c8-4a54-816d-a31678bf4514-delete_volume" released by "delete_volume" :: held 2.438s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (b992ad8a-b824-4713-9d60-4c098a99d65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1312c4f-cc44-4309-ac17-a88885d1a94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1312c4f-cc44-4309-ac17-a88885d1a94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257751868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3f450f-dc8c-44a8-acd8-849ade3921e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:54Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1fbb40-c8c3-4546-83d2-4050c8b496fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1fbb40-c8c3-4546-83d2-4050c8b496fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701bf87-6e30-420e-9561-6929c5546670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0701bf87-6e30-420e-9561-6929c5546670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3f450f-dc8c-44a8-acd8-849ade3921e8', 'volume_name': 'volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e35b6-79d3-48e1-aece-01b786ba3a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516e35b6-79d3-48e1-aece-01b786ba3a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbadafdd-e6f9-45a2-a633-a0e8aa07503c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:54 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Volume cc3f450f-dc8c-44a8-acd8-849ade3921e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8', 'volume_size': 1}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-257751868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3f450f-dc8c-44a8-acd8-849ade3921e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f06fc94d57e84b299ff400999656fea5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:04:54Z,use_quota=True,user_id='5f8d75b03fbd4b9a81828bef16f84f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Creating volume cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:04:54 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:04:54 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:54 devstack sudo[109003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 1073741824
Jul 07 23:04:54 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:55 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 1073741824" returned: 0 in 0.864s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:55 devstack sudo[109009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8
Jul 07 23:04:55 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:56 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8" returned: 0 in 0.661s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbadafdd-e6f9-45a2-a633-a0e8aa07503c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08642ed7-0b38-4728-875f-111599d5eb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:04:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Volume volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 (cc3f450f-dc8c-44a8-acd8-849ade3921e8): created successfully
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08642ed7-0b38-4728-875f-111599d5eb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Flow 'volume_create_manager' (b992ad8a-b824-4713-9d60-4c098a99d65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:04:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-99510b81-9fa6-48a7-8d4b-620b1a40e379 tempest-ProjectReaderTests-374711994 None] Created volume successfully.
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=57,cinder:UPDATE=83,cinder:INSERT=22,cinder:DELETE=4 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=60,cinder:UPDATE=68,cinder:DELETE=9,cinder:INSERT=19 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Creating offline snapshot ea95eb60-07fe-46e1-9047-580d6cc3d165 of volume cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[909d1a14-4b96-43b7-8fdc-4aeb67676ce9]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:04:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:56 devstack sudo[109013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8
Jul 07 23:04:56 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:57 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8" returned: 0 in 0.822s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:57 devstack sudo[109018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 1G
Jul 07 23:04:57 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:58 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 1G" returned: 0 in 0.838s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:58 devstack sudo[109025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165
Jul 07 23:04:58 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:59 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165" returned: 0 in 0.766s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:59 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 is being set with open permissions: ugo+rw
Jul 07 23:04:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:59 devstack sudo[109030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165
Jul 07 23:04:59 devstack sudo[109030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:04:59 devstack sudo[109030]: pam_unix(sudo:session): session closed for user root
Jul 07 23:04:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165" returned: 0 in 0.685s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:04:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:04:59 devstack sudo[109033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info
Jul 07 23:04:59 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:00 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info" returned: 0 in 0.746s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:00 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info is being set with open permissions: ugo+rw
Jul 07 23:05:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:00 devstack sudo[109036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info
Jul 07 23:05:00 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:01 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.info" returned: 0 in 0.671s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.619s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:01 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d9ef063e-b1e6-4ce4-a672-c56a7585e1b4 tempest-ProjectReaderTests-374711994 None] Create snapshot completed successfully
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-ea95eb60-07fe-46e1-9047-580d6cc3d165-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-ea95eb60-07fe-46e1-9047-580d6cc3d165-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-ea95eb60-07fe-46e1-9047-580d6cc3d165" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-ea95eb60-07fe-46e1-9047-580d6cc3d165" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Deleting offline snapshot ea95eb60-07fe-46e1-9047-580d6cc3d165 of volume cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:01 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] snapshot_file for this snap is: volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea182e0a-919c-44e4-a246-942ef71dc4a7]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:02 devstack sudo[109042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165
Jul 07 23:05:02 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:02 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165" returned: 0 in 0.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9947888-deec-4043-8733-cc4ed74a27ed]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:02 devstack sudo[109047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8
Jul 07 23:05:02 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:03 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8" returned: 0 in 0.786s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:03 devstack sudo[109052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165
Jul 07 23:05:03 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:04 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165" returned: 0 in 0.758s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:04 devstack sudo[109057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165
Jul 07 23:05:04 devstack sudo[109057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:05 devstack sudo[109057]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8.ea95eb60-07fe-46e1-9047-580d6cc3d165" returned: 0 in 0.654s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-ea95eb60-07fe-46e1-9047-580d6cc3d165" released by "_delete_snapshot" :: held 3.114s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" released by "delete_snapshot" :: held 3.145s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Created reservations ['25f6ad99-86f4-44a6-b5c8-c607cf23a681', 'a74f51a0-7320-4566-99da-72a043bc8ce6', 'f29e5ad4-750e-4e9e-ac32-84c739f46234', 'caba24cf-5f71-403f-9161-e1e00b449a50'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:05 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Delete snapshot completed successfully.
Jul 07 23:05:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-676af91c-4e6b-42b3-bbcb-b71c18d8d8aa tempest-ProjectReaderTests-374711994 None] Lock "cinder-ea95eb60-07fe-46e1-9047-580d6cc3d165-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-cc3f450f-dc8c-44a8-acd8-849ade3921e8-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "cinder-cc3f450f-dc8c-44a8-acd8-849ade3921e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Acquiring lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" acquired by "delete_volume" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6094d19-adbc-42e4-9508-f0da810574ee]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:06 devstack sudo[109060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8
Jul 07 23:05:06 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:07 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:07 devstack sudo[109066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8
Jul 07 23:05:07 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:07 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-cc3f450f-dc8c-44a8-acd8-849ade3921e8" returned: 0 in 0.655s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "cinder-quobyte-cc3f450f-dc8c-44a8-acd8-849ade3921e8" released by "delete_volume" :: held 1.520s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Created reservations ['04b00eb1-0550-48c3-b3a7-94889de44101', 'edea0b13-8c4d-45ad-9a8d-faca615baecb', '2c2a5243-b30a-4292-ad54-8c7d2b83d2cd', 'aa209f93-f29c-4c0d-81b9-bcf42a0bc750'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:07 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:07 devstack sudo[109069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:05:07 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:08 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:08 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.712s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:08 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:08 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Deleted volume successfully.
Jul 07 23:05:08 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-0503df92-2b15-44c7-b431-6ab8433a4bac tempest-ProjectReaderTests-374711994 None] Lock "cinder-cc3f450f-dc8c-44a8-acd8-849ade3921e8-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:17 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=15,cinder:INSERT=4,cinder:UPDATE=15 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:05:18 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=8,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:33 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:33 devstack sudo[109113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:05:33 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:34 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:34 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.754s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:34 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:05:34 devstack cinder-volume[88152]: DEBUG oslo_service.periodic_task [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] Running periodic task VolumeManager._thread_info {{(pid=88152) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 07 23:05:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread count: 28 {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 07 23:05:34 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-fb74cbea-1048-43f2-b136-44b526506fcb None None] thread info: [<_MainThread(MainThread, started 130835364089984)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 130835253505408)>, <Thread(Thread-3 (stat_writer), started daemon 130835253804416)>, <Thread(Rabbit-heartbeat, started daemon 130835253506816)>, <Thread(Thread-5 (_runner), started daemon 130835252604736)>, <Thread(Thread-7 (_runner), started daemon 130835252654784)>, <Thread(fd_logger, started daemon 130835250701760)>, <Thread(privsep_reader, started daemon 130835248508928)>, <Thread(tpool_thread_0, started daemon 130835239827136)>, <Thread(tpool_thread_1, started daemon 130835231434432)>, <Thread(tpool_thread_2, started daemon 130835223025344)>, <Thread(tpool_thread_3, started daemon 130835214616256)>, <Thread(tpool_thread_4, started daemon 130835206207168)>, <Thread(tpool_thread_5, started daemon 130835197798080)>, <Thread(tpool_thread_6, started daemon 130835189388992)>, <Thread(tpool_thread_7, started daemon 130835180979904)>, <Thread(tpool_thread_8, started daemon 130835172570816)>, <Thread(tpool_thread_9, started daemon 130835164161728)>, <Thread(tpool_thread_10, started daemon 130835155752640)>, <Thread(tpool_thread_11, started daemon 130835147343552)>, <Thread(tpool_thread_12, started daemon 130835138934464)>, <Thread(tpool_thread_13, started daemon 130835130525376)>, <Thread(tpool_thread_14, started daemon 130835122116288)>, <Thread(tpool_thread_15, started daemon 130835113707200)>, <Thread(tpool_thread_16, started daemon 130835105298112)>, <Thread(tpool_thread_17, started daemon 130835096889024)>, <Thread(tpool_thread_18, started daemon 130835088479936)>, <Thread(tpool_thread_19, started daemon 130835080070848)>] {{(pid=88152) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Flow 'volume_create_manager' (89bb7df8-40d0-4e1b-992e-5299e17fd110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290898d1-d911-45b8-a7ef-e8d1de69c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (290898d1-d911-45b8-a7ef-e8d1de69c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1372960504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f721ae1c-0b76-4ff4-96f9-63d99dc56616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889ece0c32b4335a6b310137b5d891f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:41Z,use_quota=True,user_id='1e2c2c1e1da74eda9c8e7e95d7565726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d6d27f-ec15-45de-8407-d8c01415b1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41d6d27f-ec15-45de-8407-d8c01415b1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3da0c74-2ca3-428d-906d-78576bd98701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3da0c74-2ca3-428d-906d-78576bd98701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f721ae1c-0b76-4ff4-96f9-63d99dc56616', 'volume_name': 'volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfbeceb-7d77-4758-9b11-b0ae47fb8dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddfbeceb-7d77-4758-9b11-b0ae47fb8dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ebd639-c851-4edb-828c-e97fa71aa8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:40 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Volume f721ae1c-0b76-4ff4-96f9-63d99dc56616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616', 'volume_size': 1}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x76fe74dfe1b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1372960504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f721ae1c-0b76-4ff4-96f9-63d99dc56616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889ece0c32b4335a6b310137b5d891f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:41Z,use_quota=True,user_id='1e2c2c1e1da74eda9c8e7e95d7565726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)}" {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Creating volume f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:40 devstack cinder-volume[88152]: INFO cinder.volume.drivers.remotefs [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] casted to osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5
Jul 07 23:05:40 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 1073741824 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:40 devstack sudo[109123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 1073741824
Jul 07 23:05:40 devstack sudo[109123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:41 devstack sudo[109123]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 1073741824" returned: 0 in 0.912s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:41 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:41 devstack sudo[109128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:05:41 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:42 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.628s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'} {{(pid=88152) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ebd639-c851-4edb-828c-e97fa71aa8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616', 'volume_size': 1}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482b3dbd-424c-46b4-924c-337304c89d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:42 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Volume volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 (f721ae1c-0b76-4ff4-96f9-63d99dc56616): created successfully
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482b3dbd-424c-46b4-924c-337304c89d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Flow 'volume_create_manager' (89bb7df8-40d0-4e1b-992e-5299e17fd110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:42 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-9b6713c0-7800-4398-98f4-0dc2f8f63ba3 tempest-SnapshotDependencyTests-43559826 None] Created volume successfully.
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Creating offline snapshot 88186b02-5fd0-4f13-8460-1fb9fcdfe6ff of volume f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74d549c-1063-427d-9f6f-39fea97d3869]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:42 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:43 devstack sudo[109131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:05:43 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:43 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.813s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:43 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff 1G {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:43 devstack sudo[109136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff 1G
Jul 07 23:05:43 devstack sudo[109136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:44 devstack sudo[109136]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff 1G" returned: 0 in 0.865s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:44 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:44 devstack sudo[109141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:05:44 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:45 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 -F qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.764s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:45 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff is being set with open permissions: ugo+rw
Jul 07 23:05:45 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:45 devstack sudo[109146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:05:45 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:46 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.679s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:46 devstack sudo[109149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info
Jul 07 23:05:46 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:46 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info" returned: 0 in 0.674s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:46 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info is being set with open permissions: ugo+rw
Jul 07 23:05:46 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:46 devstack sudo[109153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info
Jul 07 23:05:46 devstack sudo[109153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:47 devstack sudo[109153]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.info" returned: 0 in 0.691s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:47 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.593s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:47 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-bb74695f-f741-4190-9694-5fa07a34ac1a tempest-SnapshotDependencyTests-43559826 None] Create snapshot completed successfully
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.flows.manager.create_volume [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88152) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Flow 'volume_create_manager' (d26164f0-8e60-4d55-a4f8-d477ce0d7081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a7f72d-c2c8-4cd8-8365-3b29bebf9d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a7f72d-c2c8-4cd8-8365-3b29bebf9d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-07T21:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf326b6-6e0d-4084-99be-7343949c5a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c889ece0c32b4335a6b310137b5d891f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T21:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=88186b02-5fd0-4f13-8460-1fb9fcdfe6ff,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T21:05:49Z,use_quota=True,user_id='1e2c2c1e1da74eda9c8e7e95d7565726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08be023a-ce8b-4b21-a5d9-b8e8a0250005),volume_type_id=08be023a-ce8b-4b21-a5d9-b8e8a0250005)' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e899974-8cb7-4d1f-876a-15a33e7c195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e899974-8cb7-4d1f-876a-15a33e7c195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26b6ada-35a7-4f1c-a406-7b298569e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26b6ada-35a7-4f1c-a406-7b298569e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fdf326b6-6e0d-4084-99be-7343949c5a3d', 'volume_name': 'volume-fdf326b6-6e0d-4084-99be-7343949c5a3d', 'volume_size': 1, 'snapshot_id': '88186b02-5fd0-4f13-8460-1fb9fcdfe6ff'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0f906-1868-4857-a7bd-274e3b34bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f0f906-1868-4857-a7bd-274e3b34bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c0bca-48bf-4299-a728-773cde2cee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:48 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Volume fdf326b6-6e0d-4084-99be-7343949c5a3d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fdf326b6-6e0d-4084-99be-7343949c5a3d', 'volume_size': 1, 'snapshot_id': '88186b02-5fd0-4f13-8460-1fb9fcdfe6ff'}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-fdf326b6-6e0d-4084-99be-7343949c5a3d" by "_create_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-fdf326b6-6e0d-4084-99be-7343949c5a3d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Creating volume fdf326b6-6e0d-4084-99be-7343949c5a3d from snapshot 88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Selected osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5 as target Quobyte volume. {{(pid=88152) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" by "_copy_volume_from_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:48 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] snapshot: 88186b02-5fd0-4f13-8460-1fb9fcdfe6ff, volume: fdf326b6-6e0d-4084-99be-7343949c5a3d,  {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fe7e7b-959f-457e-bb7d-179a70251167]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:49 devstack sudo[109156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:05:49 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:49 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.850s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Creating direct copy from snapshot {{(pid=88152) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbca63-1848-4576-8251-9efa46d98205]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:49 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:49 devstack sudo[109161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:05:49 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:50 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.783s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:50 devstack cinder-volume[88152]: DEBUG cinder.utils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Path /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d not found in is_blk_device check {{(pid=88152) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 07 23:05:50 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:50 devstack sudo[109166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d
Jul 07 23:05:50 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:55 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d" returned: 0 in 4.414s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:55 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6edfc1-7a9c-4226-9cfd-895f678477cd]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:55 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:55 devstack sudo[109179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:05:55 devstack sudo[109179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:56 devstack sudo[109179]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.921s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.image.image_utils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Image conversion details: src /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616, size 1024.00 MB, duration 4.41 sec, destination /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d {{(pid=88152) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 07 23:05:56 devstack cinder-volume[88152]: INFO cinder.image.image_utils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Converted 1024.00 MB image at 231.94 MB/s
Jul 07 23:05:56 devstack cinder-volume[88152]: WARNING cinder.volume.drivers.remotefs [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d is being set with open permissions: ugo+rw
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:56 devstack sudo[109185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d
Jul 07 23:05:56 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:56 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d" returned: 0 in 0.664s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" released by "_copy_volume_from_snapshot" :: held 7.726s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-fdf326b6-6e0d-4084-99be-7343949c5a3d" released by "_create_volume_from_snapshot" :: held 7.762s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.786s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8c0bca-48bf-4299-a728-773cde2cee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf326b6-6e0d-4084-99be-7343949c5a3d', 'volume_size': 1, 'snapshot_id': '88186b02-5fd0-4f13-8460-1fb9fcdfe6ff'}' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fd98af-850b-43bd-bb0c-d74630978b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 07 23:05:56 devstack cinder-volume[88152]: INFO cinder.volume.flows.manager.create_volume [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Volume volume-fdf326b6-6e0d-4084-99be-7343949c5a3d (fdf326b6-6e0d-4084-99be-7343949c5a3d): created successfully
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fd98af-850b-43bd-bb0c-d74630978b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88152) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 07 23:05:56 devstack cinder-volume[88152]: DEBUG cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Flow 'volume_create_manager' (d26164f0-8e60-4d55-a4f8-d477ce0d7081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88152) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 07 23:05:56 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-f81b81db-972c-4838-afd8-a3138a522d15 tempest-SnapshotDependencyTests-43559826 None] Created volume successfully.
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-delete_snapshot" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" by "delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" by "_delete_snapshot" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Deleting offline snapshot 88186b02-5fd0-4f13-8460-1fb9fcdfe6ff of volume f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] snapshot_file for this snap is: volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[2793b9a1-66a9-4bcc-8ca3-f66698bc2dff]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:57 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:57 devstack sudo[109189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:05:57 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:58 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.775s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:58 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.remotefs [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88152) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 07 23:05:58 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f414e89-755c-49a4-88d7-109bfbd07c10]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:05:58 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:58 devstack sudo[109196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:05:58 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:59 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.751s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:59 devstack sudo[109201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:05:59 devstack sudo[109201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:05:59 devstack sudo[109201]: pam_unix(sudo:session): session closed for user root
Jul 07 23:05:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.818s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:05:59 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:05:59 devstack sudo[109206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff
Jul 07 23:06:00 devstack sudo[109206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:00 devstack sudo[109206]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:00 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616.88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" returned: 0 in 0.692s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff" released by "_delete_snapshot" :: held 3.132s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" released by "delete_snapshot" :: held 3.157s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:00 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Created reservations ['26c867fb-1054-41a0-86c4-7279560106db', '37ac8e86-9ebd-4670-869f-f1351db5779f', '957231ef-f712-47f3-a8d5-ef3a5c3c0b92', '812f2541-6de2-4127-9bd3-b81bfed79019'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:06:00 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Delete snapshot completed successfully.
Jul 07 23:06:00 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-d4644d6f-1f1a-48c8-a85f-440121bb3284 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-88186b02-5fd0-4f13-8460-1fb9fcdfe6ff-delete_snapshot" released by "delete_snapshot" :: held 3.307s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-f721ae1c-0b76-4ff4-96f9-63d99dc56616-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-f721ae1c-0b76-4ff4-96f9-63d99dc56616-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" acquired by "delete_volume" :: waited 0.017s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76fab79-10bf-44e0-aafb-8e09f06defd2]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:01 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:01 devstack sudo[109209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:06:01 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:02 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.797s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:02 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:02 devstack sudo[109214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616
Jul 07 23:06:02 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:03 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-f721ae1c-0b76-4ff4-96f9-63d99dc56616" returned: 0 in 0.669s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-f721ae1c-0b76-4ff4-96f9-63d99dc56616" released by "delete_volume" :: held 1.530s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Created reservations ['ac7ef685-b7cd-4d74-a0b9-c260f1fc0672', '4f055258-b4d0-45bf-980d-f1051373119a', '9666546d-5139-445c-87cd-38df504c4ba1', '3749bbed-525e-49b3-af58-1a667fd96b50'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:03 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:03 devstack sudo[109217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:06:03 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-fdf326b6-6e0d-4084-99be-7343949c5a3d-delete_volume" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-fdf326b6-6e0d-4084-99be-7343949c5a3d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" by "delete_volume" {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" acquired by "delete_volume" :: waited 0.020s {{(pid=88152) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4165553-59bc-4d57-b1ef-703dda785d89]: (4, 'qcow2') {{(pid=89230) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:04 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.719s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:06:04 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Deleted volume successfully.
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-ece4dc75-227c-457a-ad8d-752050a1c5aa tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-f721ae1c-0b76-4ff4-96f9-63d99dc56616-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:04 devstack sudo[109220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d
Jul 07 23:06:04 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:04 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d" returned: 0 in 0.806s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:04 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:04 devstack sudo[109225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d
Jul 07 23:06:04 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:05 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096/volume-fdf326b6-6e0d-4084-99be-7343949c5a3d" returned: 0 in 0.685s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-quobyte-fdf326b6-6e0d-4084-99be-7343949c5a3d" released by "delete_volume" :: held 1.539s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG cinder.quota [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Created reservations ['793f2baf-b2d5-421b-af51-be6629d7bbdf', 'a9d7eede-d776-4483-a7a1-a56c6782b2f4', '529a8569-54f7-4ea5-94c1-6e771207b742', 'b0a36ceb-1739-43c2-8cbf-4539d1ff3fa6'] {{(pid=88152) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5': None} {{(pid=88152) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG cinder.volume.drivers.quobyte [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f720068f-7dfa-4cb6-b773-43a07c798ab5'] {{(pid=88152) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.lockutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88152) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 07 23:06:05 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096 {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 07 23:06:05 devstack sudo[109228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096
Jul 07 23:06:05 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 07 23:06:06 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root
Jul 07 23:06:06 devstack cinder-volume[88152]: DEBUG oslo_concurrency.processutils [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ae6a09c8ce22388f4108baa62430f096" returned: 0 in 0.686s {{(pid=88152) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 07 23:06:06 devstack cinder-volume[88152]: DEBUG cinder.manager [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Notifying Schedulers of capabilities ... {{(pid=88152) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 07 23:06:06 devstack cinder-volume[88152]: INFO cinder.volume.manager [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Deleted volume successfully.
Jul 07 23:06:06 devstack cinder-volume[88152]: DEBUG cinder.coordination [None req-4c8ae6a1-bd83-404f-8a72-ba9ccf266f10 tempest-SnapshotDependencyTests-43559826 None] Lock "cinder-fdf326b6-6e0d-4084-99be-7343949c5a3d-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=88152) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 07 23:06:15 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:UPDATE=33,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=5 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 07 23:06:16 devstack cinder-volume[88152]: DEBUG dbcounter [-] [88152] Writing DB stats cinder:SELECT=25,cinder:INSERT=9,cinder:UPDATE=23,cinder:DELETE=3 {{(pid=88152) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}